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This docusent i« designed to .assist school districts 
to iiplesent the Massachusetts State Board of EducatiX5n regulations 
requiring the setting o^l perforiaiioe standards in basic Vkills af 
three grade levels. The appropriate procedures are described in the 
■anual: O) setting of basic skil.ls obl^ctives,- at three grade 
levels: (2) the selection of tests or biiler measures that adequately 
Qpver the objectives: (3)' the -settlnq •of ia ainiBuin acf:0ptable .score 
on each.testfor aeasure.; and (U) the reporting pf >the nuaber and 
characteristics (sex, race , 'etcs*» of -those students achieving below 
the local s'tandArd. Info'raatlon Is* appended on testa'cuitrdntly 
available for assessing basic' skills develops en t at the high schobl 
level amd general ac"hi eve went: test series, as well as on holistic: 
scoring, (Author/CTM) , 
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IWTRODUCTORY NOTE 



This second edition of the project managers' manual 

for the MEC-ETS standard setting itudy includes several 

y chAnqes based on the review of the earlier draft by Dr, 

Michael zieky (E.'^S, Princeton) • The earlier draft was 

/ 

also reviewed informally by Majssachusetts Department of 
Education staff. " . ' ^ 

Sinc'e the publication of the first draft, the MEC- 

\ / 

ETS project has proceeded oi^ schedule, with a minimum of 
difficulty. The steps outlined in the manual have met 



.this f.irst test of fea8ib:^lity . 
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Overview of the Basic Skill IroproVamanV Policy -^.gftplliatloni for 
Sthool Districts 



In Jan\*ary 1919, 'the Massachusetta State Board of Education 

published the regul ation s, for Im pleroe ntation o f the Basic^SkUls Iw^proye^^ 

" ■ - ' . ^ . . ^ ... .. ^ 

Policy adapted by the ^ar^d- in August, 1978. This manual has been developed 
, to assist school districts in carrying out the State Board's mandate which 
. includes ^s^.^^e of the required steps, the setting of performance standards 
in basic skills at three grade levels. ' . 

While- the manual will deal with the setting of performance ^tandards, 
it is important to note that the setting of standards is only a means to 
' an end. The purpose of standard setting and testing is to identify those 
students (the target group), who need special attention with basic skills. 
.The purpose of the state's policy is to assure that these students are 
. identified and that an effective program is provided for them. To this 
end, the state has called for standard-setting,* testing, documented program 
planning; and a monitoring of program effectiveness - all with broad based 
. community inj||X>lvement . ' ^ 

At the outset, some ^clarification is needed^on the meaning of the 

r 

tferw "minimum standards" in the context of the state's regulations. The 

state regulations speak "minimuJn standards" as a »set of^ objectives in 

.■ f 

the bafiic skills and a level pf achievement on the basic skill objectives. 
The objectives represent the content - what has to be attained by the 
, minimally competent student. The level of achievwnent represents the 

to which .the objectives' must be attained In order, for the student's 
skill level to be considered sufficient ox minimally accepteOsle. The 
l^y^ot achiev«n>ent can only be identif ied^by some measured performance 

\ o ^ V ■ ' ■ 
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^ 4 

• level of achievement can only be identified by somp measured performanc'e ^ 

which indicates A level of achievement. lx\ effect, standardif can bfieome 

operational only when they are related t6 some measurement of the per- 

fonnance of individuals or groups. Any description of levels of ' 

achievement- on-G^rt«in-j^8ic-8ki-l-l-objecti\^s-muftt-be-transiated-i 

passing score on a test a set of measures. Thus, for present purposes, 

the operational definition of a minimum standard is the minimum acceptable 

total score on kn appropriate test or measure, •which covers basic 5ktll"« 

objeetiVe^ in reading,- writing, and m^thtematics. 

. To carefully implement the state regulation on standard setting, the 

following steps are called for: * 

• ■* 

1) The d€?*finition by the local staff of objectives, at three grade , 
levels, that are considered basic skill .objectives . At the .secondary level, 
these <5bjectives must include but cah^ go beyond the list of objectives 

developed by the state. . c; * 

> ' f- ■ ' ■ 

2) The selection of tests or/otiher measures that adequately cover 
the above objectives. • • 

3) The setting of a minimuai acceptad)le score on each test or 
measure. Th^^s score represents Uie minimum standard of basic skill dev^op- 

ment ^o which the local district^ choeses to hold itself accountable. 

* ■ ■ ■ ♦ ' 

Students achieving belov^ this st^Uidard will be giVen special^attention in 

/ * 

t^e system's basic skills improvement program. 

» 4), The reporting of the hum^eV and characteri'stica (sex, race, etc.) 
'of those st\idents achieving below jthe local standard. 
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While certain students will be identified. as below the local stand- 
ard based on their performance on a specific teat or assessment exercise', 
rbc&l school officials need not 'conclude from this single test score that 



---a~giv^n-8tudent~ lg-cl6*rly-in-heed~6r Tidt~^^^^ 

^ more defensible use of teat data calls for , tihe \tentative classification 
p of a student as needing remediation based 'on a below" standard and pel^haps 
• a borderline performance on the basic skij^ls measure, with the final 
clarification depending on the corroboration of thi's evfdence ly oth^ 
information. To cite an extreme example, a 'student who for the p^st three 
years scored in the 80th percentile in matfhematics should not be classified 
as a below standard student when he or she on a given day did badly 
on one test. Presumably, these new regulations do not call. for the aban- 
■ donment of established principLes in test N^rlterpretation; The cardinal 
principle in the Interpretation of test SQoires is that test scores should ' 
be interpreted together with other avai-laM^e information - never in 
isolation. > ' ' 



\ 
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. - • Section 2 . 

t 

Local "Deciaion-Ma^cing in Standard Setting 

As note^d earlier, tha state regulations call for community involvement 
at several points in the planning and iinplementation of tha local districts 
basic skills improvement program; Community involvement is required in 
the following: - . ^ 1 \ 

1) the establishment and periodic review of -program plans ^t all. 
o5 the three levelifc derscribed earlier 



riDed earlier 
'iodic revJMv 



2) the establishment and periodic review of minimum standards for 
ee^ch basic skill at each level. 
ComnunJLty inVolven«nt includes participation of parents of public school 
Students, j.ncluding Title I {Barents, employers, students at the secondary 
level, teachers, administrators, and representatives of the ge^ieral public. 

In the implementation of this requirement, consideration should be 
^iven to efficient use of people's time as well as the expertise required 
for each of the tasks. The approach taken in thisj manual calls for 
leadership from teachers and school administrators in drafting proposed 
plans and formulating proposed standards with the' coninunity representatives 
joining with the staff ort a systemwide auJvisory committee, which will make 
recornmendations- to the school committee on both the basic skills program 
and the local performance standards., 

The following table depicts the roles of these two groups at each 

. V • 

point In the process: * N ' 

)■ ■ ■ , • . 

* 



Prof#g«ton«l 

Staff 



Advifory 
Goimnitta* 



1) The identification of ba«ic skill 
objectivas 

2) Selection of appropriate t«9t8 



^3) Setting of performance standards 
oVi~tests~or~oth~er~mea«u^^ 



4) Planning instructional programs 

for target population if 



initial 

reconmendation 
completed by staff 



initial" 



final 

recomniendation 

■) 

reported to 
comnfiittee 

final 



recommendation baaed reconmiendation 

on staff judgempntf , 

and field testing. ^ ■ ^ ' 



initial draft of 
plan 



final 

recommendation ' 



The advisory committee, as shown above, does not make final decisions^ut 
only final reconinendations. Final decisions are the designated respohsibility 
'of the local school conroittee. In the approach presented above, the pro-^ 
fessional staff assumes the responsibility for the actual selection of tests, 
which entails the matching of test items to the basic skill objectives." 
this is a technical activity requiring some familiaril^y with tests aYid 
objectives. In the setting of standards, the procecjlure recommended here 
begins with staff judgement, because , Che educational standards maintained* 
by the school, for example in gradingv promotion, and placement decisions 
are fo-und in the consensus of teacher judgement. , ; ^ 

The advisory committee referred to .above, as envisioned here, would 

> 

be a system-v/ide committee made up of staff and cownundty representatives 
as called for in the state regulations. The of professional staff 

described abo^ would take place in three grade level .committees. Need,- 
less to sSy, already existing comraittefes and local conditions will undoubtedly 
shape the final design of the decision-making structure in each oommunlty. 
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The advisory coounittee represents 8in\ply one apprxjach to conmunity involve- 
ment;, surveys, public hearings, etc., represent other possible approaches. 
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The Merrimack Regional Planning Council -..wi 11 direct the design and 
implementation of the services made availi^Dle/ for the purposes of^ ^ 
implementing these regulations, to those districts served by the flerrimack 
Educ^Stion Centep. This council will/ be made up of one representative from 
each district paftrticipaling in 'the project. 



\ 
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Section 3 

■ • ..... _ J . ... 

Identi-f ication of Grade Levels and Basic Skill Objectives 

4 

The school committed is called upon. to desiTfiate three grade levels 
,at which basic skills testing and standard setting are required. The 

0 

project facilitators will undoubtedly meet with the appropriate administrative 
and supervisory staff^ to identify the specific grade leVels to be proposed- to 



the school committee. The regulations describe the three levels as 
fpllows: , * . ., 

' I) ^:arly elementary - K through grade 3 

2) Late elementary* - gnade 4 through grade 6 

3) Secondary - grade- 7 through grade 12 (witrh testing begun no later 
than grade 9) 

ht each level, the. local school district miwt a) identify students iti 
r . ■ 

t 

need of special attention in basic skill development by administering tests 
for which a local performance 'standard has been *set, iind b) develop, main- 
tain, and periodically evaluate a program to meet the neecJs of ^ese 
students. ' • . . 

After the three grade levels have be§n determined, the staff needs to 
identify the T skill cx)ntent in reading, writing, and mathematics 
that they judge to be basic for students at each ^pf these grade levels. A 
staff committee at^ each grade level should exaunine the present curricular 
objectives (and, if need b,e, other objectives) ^and select those which they 

f ■ 

consider basic . At the secondary level, the objectives identified by the 
Vocal district must include but niaj^go beyond those objectives specified 
in the state regulc^ions. 



bi< 



... ^ ■ 

The selection of . objectives at the two elementary levels might well 



gin with the identification of those objectives which at the elementary 



level represent reasonable ateps -toward the attainment of th6 state 

specified secondary level objectives. 'Many of these" secondary " level 

objectives can be attaindfi to a limited degree in elementary grades. 

The successful attainment of complex secondary level objectives clearly de^^ends 

on the earlier attainmen,t of^more el^inentary objectives. As a guiding 

suggestion, grade leyel Qommiktoes might do well to begin by reviewing 

. the ata^e specified second ar^ l^vel objectives b6<yiu4e th^<ij%al^ 

■ . \ .■ . •» ■ ■ ^ ..■ ■ ■ 

these objectives by virtually all N^.the students is'^JJo ultimate gojrl of 

the basic skill improvement program. \ Perhaps a chart showlig where eac!^ : 

of these final objectives is introduced''^^nd atta^.ned by most , 

students might prove useful. This chart mi"^t, for example, show the, 

following in reference to one b^sic skill objec'liive in mathematics:. 

• ^ 

^ Early Elementary • Later Elementary Secondary (State Reg.) 

1.) Add and aubtrai:?t-»4,jholj 1) Add, subtract, I) Add, subtract , multiply 

numbers ^one and tv>r-^ multiply and divide and divide whole numt 

digit numbers) Whole numbers (one ' bers (three to five ' 

and two digit numbers), digit number q) » 

_ s - * ■ 

The end product ^of this first task by each of the grade level committees- 
is a complete list of grade level • basic skills objectives in reading, writing, 
and mathematics. This list 'should not include all objectives given attention 
at this level but only those tfonsidered basic . Presumably, th^ more able 
students will be working on learning activities related to more advanced 
^objectives at each of these grade levels. It is • important that tht^se mini- 

« 

mum objectives do not become the maximum . The state requirement^ deals with 
the (^a<tiaijim of .minimum competency in basic skills by virtually all of the, 
students. It does not describe the full range Of objectives to be. attai"ned 



.by. the average and a*>ove averag* «tud«nTTr~^ nwS^e clear thia distinction 

. i . 

between the tniniwuin objebtivea in batic^ tkillexarid the full rknge of expep 
te<J attainment, the ;t£ftde, level cxjipmitteei might do well, to specify those 
objectives which t^ej; do consider not as b^sic sJ^ills as covered by the 
state program but as more advanced skills which they nevertheless expect 
a large number, if not the majority, of students to attain. 

The lists of biisic skill objectives identified by each of the three 
grade ievel committees would then' be presented for review and approval by 
the systemwide advisory co'nmi.ttee. These lists of objectives will then 
guide the, selection of th^ tests to be administered at the three grade 
levels. These tests should provide substantial coverage of most if not all 

9 

of these objectives. These lists will -also guide the description of the 
learning activities which will, in fact', constitute the basic shills 
improvement program. ' " " 
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Ht Ratriav and Selection ^ 



In matching tests to listed basic skill objectives, two possible 
proaches are either the selectior) of t^itji already available or the 

the present 



developinent of new test g to meet local objectives. Given 
State of the edjicational economy , tihe latter cpurs-e, loca 



district test 



development, should be errjbrafced only as a last resort. F<i>r all' but the 
largest school districts, the unit coat of such a locally developed .test 
with a scoring and reporting system/ would in most cases be prohibitive."^. 
This manual, willyassume that at all thrrfa levfels, MKC districts will be 
using currently available teats. " ' 

Appendijc B includes a comprehensive but by no means exhaustive list 
of basic skill tests availab^I.e'^ (as of January, J.979) • As a firfefc, rough 
cut in selecting tests, grade level cbit^lh:tee8 should identify tests that 
meet the following^ general requirements: 

1) Test content is appropriate, i.e., covers basic dkills,rt>a8ed 
on general descriptions provided by the^ publisher 

2) The kinds of items used are appropriate based on general des*- 
•criptiorvs and exeunples provided by the publisher' 

3) Test has adequate statisti<3^il properties, e.g., reliability of 
total score at .85 or above. * 

M) Useful score re^rts are available, which include: 

a) a frequency or local percentile distribution which is 

necessary to. determine the impact of a proposed standard 

: b) norm: referenced percentile scores, which ere extremely 
^ , useful (but not absolutely ne-essary) in reviewing a**pro- 

- • posed standard 



A future service offered through MEC might include an item bank of basic 
skiil rtems, pr^-tested and scaled by different levels, ayid a uniform 
•coring and reporting service. | - " 

^ i4 • 



\ c) clu«i:«3r scores and/or individual student profiles, whfbh ar« 

— useful for subsequent instructional planni,ng 

. TestB which fail meet^the a^bove requirements should b« set aside.^ Tests 
that^ do meet thes^ requirementd should then be subjected '.to a<i![ditional 

:__8crutiny_ by the appropriate -grade level -oofim)^ These -cownit tees wil l 

undoubtedly choose review first of all those tests currently in use 

which meet the above requirements. Allstests should then be reviewed item 

by item by one or more • (preferably 2 or 3) committee members using the 

Ba^sic Skills Item Review Form (see Appendix C) . In completing the review " 

form, the committee membets^ rata eagh jLte"> according to: 

X.) when the content covered by the item is taught in thi-s school - 
system in reference to the grade level in question - earlier? 
later? 

/■ ■ ' ' ■ • > 

2, ) whether the content covered by the item is basic or advanced 

for this grade level? 

3. ) which basic skill objective does the item measure? (Cite the 

objective by number from the local list). ,nj 

As a rule of thumb, any test in which three fourths or more of the items 
are judged as measuring basic skills apjfiropriate to the grade level would 
be accepte^ble foj present purposes, provided the test also coveri^^ these 
objectives in a thorough and balanced fashion. A test presently in use 
that satisfactorily meets the above requirements qo\x\A be chosen for the 
sake of economy and other uAful purposes over a test that had slightl^ 
better coverage of the basic skill oljjectives. 



In ielectiag t^jibs at the secondary level, it will also be necessary to 
check with the i^ate's list of Approved tfrsts, which^will be available 
in MiyV 1979. i S 



Given th« n«tur« of th««e ta«t« and biudc character of th^ baaio 
•kiHn aa desoribad herd; there is little danger of student! •xcellin9 
on advanced items while d^ing poorly on the basic skills items on t^e 
same test. An analysis of error patterns from" time to time' wo^ Id answer 
any questions concerning this possible problem.. For example,__on "Ja. 50-item 
•^test in which 35 items were identified as basic skill items ^ind 30 correct 
answers was the minimum acceptable score (the standard) , one would assume 
and could readily verify that those performing below the standard missed 

* 4. 

most of the advanced and some of the basic skill items. One would also 
assume and could, verify that those above the standard missed vary few of 
the basic stei 11 items and some of thci advanced items* Admittedly, this 
.argument rests upon some assuinptions that can and should be verified. 

Having identified basic skill objectives and selected teste to match 
thes^ objectives; the grade level committees are prepared to begin setting 
a standard or cutting score bated on local expectations. 



I 
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Th« Scotlng of Writing Sainpl«« 



- ■ - -f 



The diacuasion of testing' thu« fii in th^ manual "haa dealt with 
objective, machine acorable testa. The ajtate requlrementa call for the 
•coring of a writing sample r><jt the t^condary level (and perh»6« a^ one 

~dr~bot}r6f "tfienBlenie^ The~scoring~~oir^w^ r~~ 

requires a set of procedures which enable each writing •an«>lA to be 
scored in a consistentL This could be accoit^plish^d by a set of 

detailed decision rules which left rJ room for teacher judgement. For 
exainple, one could devise a detailed amalytical scoring procedure in 

which one point is taken 6ff for every word rt^isspelled , one point' of f whenever 
subject and verb do ndt agree, etc* 

A second method, called holistic scoring, provides for the consistent 
scoring of writing samples by having these writing samples scored in a 
workshop setting ip which teachers come to consensus understanding of a 
scoring system in which' a single score is assigned on the basis of a complex 
set of criteria. These criteria are formulated only in a very generAl way. 
In the holistic -approach, consistency is assured because each piece is 
judged by more than pne reader, with inconsistencies in .those judgements 
resolved by additional readings. (Appendix D describes some of the features 
of holistic scoring.^ ' , ' 



As ,a part of the MEC project, an ^say scoring workshop will be offered 
on May 17 for all participating di^trjLc^s. At this vorkshop only secondary 
level papers will be scored. Additional sessions might be added for other 
loyels. , . ^ 

The tasks required for a holistic essay scoring are first listed here 
and then described in more detfil below. * \. ' , 

. . , • '17 ■ , . ■ 



1 * . ■ ' . ■. . . 

i I, . ■•^•^V^.^'^ of tfve topic or writing fX0rci»as 

If ^ . ' 

2) the administration of thm writing exarcisa 



3) the •election of readera for the aooring aesaion 

4) the- aubmiaaion of con\pl«ted , writir\g aaxnplea to MEC ^ 

5) the ildditionVil coding bf paperi by MEC (iyatem; schoolt eacher codes) 

6) the iseloction and duplication 6f training paper^ 

7) the conduct of the scoping session 



' 8) the settihg'df a proposed standard for each district 

i . - ■ ' 

^ 9) papers returned to schools (teachers) 

f ^ . 

10) scores decoded, and class roster- lists prepared 

■ ' \ . ■ \ 

\ One end .product of this proems will be a list of students, each 

with a writing scorNy These scores, along with other test score data, 
will be'^ collected for computer analysis as part of the Standard setting 
study. * 

Several of the tasks listed" ab<^e call for farther explanation, 
y ^1) The sele ction of the writing exercise. With assistance from " 

y, ■ 

the ETS Center for the Assessment of Writing, MEC will make available 
a list of possible writing exercises, from which each district's grade 
level committee will rank the exercises in order of their preference. 
The exercise which enjoys the' highest total ranking "from all districts 
will be the one used .by all pa^rticipating districts. It is essential 
that all districts inv(5lved in the same scoring Session use the same 
writing exercises. 

1 . .y « <r ^ 

2) ' The administration of the writing exercise . The student 
essays are to be written in the classroom without aids such ^as 
a dictionary. Allow twenty minutes and, twenty minutej^i^ only. The 
date of the assignment is not restricted; howevar, MEC must receive ' ^ ' 
papains by Tuesday, May 8. The atudents may write on afiy type of 
^ ' 8*1 by 11" pagpar. .Both aidea'of tha papar may be used, though It 



i 
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i« iim)ortAntV:hat each ttudant uaa no nora than on# piaca of paper. 

Bafora thA aiaay writing, aach atudant racaivat 3" x 5" card or 
otKar paper in acft^ition to fhe papa r on which the essay will ba written. • 
■ Each atudant rWokls his or h^r name, taachar, class, and 'a<#hooi 
L^* At the bottom of- t^^e card, the student writes a. five digit 

number followed jby a single latter that he or ahe has created. (The only 
restriction i«- thatr each digit of the' number must be diffe^nt.) . For 
example. 92831G, cfr 47682Z. Thls^code is used to assure anonymity of 
essays' during the .essay reading workshop. - . 

The student t^en copies the/number and letter" exactly as above at ^ 
the upper right qpmer of the <ssay paper. Students should be told not 
to put any other' identifying informatiion on the essay paper. 

The tea'cher is to collect the cards and retain them. This will 
enable the teaorfier to^ decode the papers v^on retijfm from MEC, so that 
papers can be returned' tp the students and pcore roster lists prepared. 

After the; essay writing, the essayii are collected by the teacher. 
Using the po9tage-)orepaid labels the teacher forwards to ,>!EC the 




1 



' ; student essays with a cover sheet indicating school , teacher , grade , and class . 
The receipt of the essays at >!EC must be guaranteed no latel than 

Tuesday, May 8. A sanple topic and teacher instruction sheet is inclufli*^ 

* ■ 

in Appendix E.» ' 

3) The aelection of reac3ers > The readers should be teachers of 
writing at the same grade level as the students -^^^ose papers ar^e being 
scored for supervisory staff familiar with student writing at several . levels ) • 
For the one day workshop, one teacher (scorer) should be available for 
every 200 student paper* submitted, if the studant rasponsas average 
about ^^^y^ quarters of a page in length. For avery 10 reader f at thm 
CD?/- « icoring sasaion, 'two aides (parents, older atudants, ate.) will ba required. 
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4, 5, 6, i 7) Th# «uta(ni««ion of th» pakP^rii/ to MEC , addiitional coding ^ 

^ • " " '■ « I! ' - • ^ 

tha a»l»ction of the tralQinq pap»rg , and th# t cynduct of ncpring iaasioQ 
will bm provided f^i: MEC b]^ETS. (For tnf ormatjjion on these steps, consult- 
the ETS Basic Skills Assessment Manual for SCo^iAg the Writing Sainple.) 

By At the completion of the scoring sesJion, tha teachers who serve ^ 



ah scorers from each district will ^be asked tB select a particular ^core 

• / ■ 
that represents, in their judgenwfntf the minAnum acceptable petformance 



on the writing sample ;Ln their dlstri<:t. 



ii( will then review this 



proposed standard in a subsequent meeting w|th the grade level committee, 
\^ir^^^ district, using sampll (training)/ paj^rs to illustrate what 
the scares mean. .This proposeq staridard wilj^' be included in the final 
report to^ the Advisory Cqmmittee as one the proposed standards. 

9) MEC will re-group\the essays by School and by teachers within 

! J " * / 

\ ^ : ■ t I 

each school for their return Lo the class/room. *' • 

i ■ 

10) Using the master codte list provided by MEC (see Appendix F) , 

... i , :' ^ • ■ 

each teacher will recofd eacii student' d iBcore ^ a roster list. A copy 

I ■ 

of this list will then be "rejfeumed to the facilitator for inclusion 

f ■ . 

in th^ data collecTtion phase of the standard setting study. 

These same procedures will be followed in the event that additfonal 
scoring sessions are scheduled for one or both of the elementary levels* 
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^ Section 6 



Methods of Setting Perfonaanpe Stitn<lard« 



Introduc^ion 



The mAin^goel of this Sjsction is to d^cribe two rational methods 



local school district personnel can use t^l arrive, at standard 



8 on pro- 



ficienay teats, Therk is no single met'hod or procedure for setting 
standards that is good for all situatiorfs. Whence stan^lard ia necessary, 
care shoui^! be taken in selecting an a^^propriate proc^ure- Further 
cautioa must be'exercised in interpreting. and using standards, particu- 
larly when the consequences of a student bein^ above or below the 
standard- are perious. • ^ , 

' \ 

The Use of Minimum Performance St^mdards 

Pi standard on a proficiency test can be u^ed to define the level 
of mastery of a basic skill that must be reached by a student to satisfy 
locally •determined standards, k stamdard is our best estimate, of how 
much mastery Is enough to be reasonably assured that a student has 
mastered those skills. A strength of using a startdard lies in it/ im- 
partial application to all students. fWever, when standards are 
capriciously arrived at^or followed blindly^ the desired^ virtues of 
impartiality can become indiscrijminate or systematically unfair obstacles 
to students. 

One dangerous implication of a standard is that it is often per- 
ceived as em absolute and precise indicator of who has achieved mastery. 
But tests are not perfect measurement instruments^ students are not 
perfect test takers «md standards are not set by p'erfect judges. Given 



tha«0 important spurcep P< •rror, thore is v«ry_ little assurance 
that a 'student with a score just Above the standard is superior to a 
student just below the same standard. A standard, properly set, only 
can assure us that on the average^ we will make fewer mistakes using 
that score than using any other score* ^ 
Therefore, ifi situations where test performance is an integral 
part |f a district*!3 requirements for student placement, .standards 
shoul<3 be determined iith care and caution* In any case, a test score 
is but one piece of informaf:ion about a student arid must be interpreted 
in light of other data, including courses taken, classroom perfGvjfliance , 
teacher judgements, and other test "data* 

Types of Errors- ' ' 

Ideally we would liketo be able to identify students needing 
supplemental instruction without making any errors in classification* 
Our experience in administering tests to representative groups of 
students .tells us that students' tesLt. scores tend to be normally dis- 
tributed like below* ^ 



H 



O 



E 



Ettim«|«d 
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Most of thie students will be "masters" qf the material, some 
will be borderline fiijtudents, and .some number of students will be 
< "rton-masters" , But given the imprecision of measurement (from both 
t^est itself and student performance fact^ors) there-tls no place to 
drhw a line (standard) through the distribution that separates the * 
mistery groups without error. We et>uld kepp our classification errors 
to a minimum if the three grc^^ups of scores were distributed like those 
beloW; wit^h the mastery and non-mastery groups clearly separated and 
the borderline students in the middle- 




• The performance-based methods of selecting standards allow Us to 
look at student performance i/i/just thl3 way* The identification of the 
groups, however, adds another ^ource of potential errors - teacher's 
judgements. ^ Ntore will be said later about how these procedures work. " ^ 
In practice the mastery and non-mastery groups^ ten?! to overlap as shown • 
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If the standard ia at the vertical line in the figure we cah see the 
approxtmat;e magnitude of two tyj^ea of errors\in classification. The 
students whose scores fell- in the shaded »part of the curve (A) are the 

i 

non-masters" who 'passed" the criterion. This group^ is sometimes re- 
ferred to as Vfalse-ixjsitives" . The students whose scores are in th6 
other shaded section (B) are the "masters" who "failed" to meet the 



criterion 



i 



Eiy moving the standard higher or lower along the horizontal 
axis, we can redact' one or the other kind of error. But when we reduce 
the errors of one type , we increase those of the' other type. Sometimes* 
tradeoffs can be rational iz.ed . As one moves the standard higher he is 
saying that it is n^e important to identify all or most of the "non- 
mastery" fpr supplemental instruction with the risk' of including more 
students who have already mastered the skiljL in €he supplemental program, 
As one iTK:yveH the standard lower, one is willing to let more ^'non-masters' 
pass to avoid holdipq back any potential masters* ^ 



Standard %%\ 
toEhminatt 
Fatst Non-Masttrs 

Fllaa Mattars 
Art Shadad 




N 



I 

o 

i 

E 



Falsa \ 

Non^Mastari 
Ara Shadad 



Standard Sat 
to Elimlnata 
Falsa Mastart 
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Al though some prrors in claaaification aro inevitable, they 
^ahould be held to a minimum. Coilaideration ahould be given .to the ' 

♦ 

direction of the errors the district woyld rather make. The following 
social, political and economi^iasues are legitimate Concerns that 
affect the placement of standards. 



-District resources for providing supplemental instruction* 
A district must have appropriate staff (both in number and 
training) , space and prog^ram material to aid all students 
identified as needing supplenjental assistance. 

- Proficiency assessment as mandated by the state is not in-- 
tended to be punitive to students. The intention Is clearly 

^ ^n identification of students who need help in gaining 

mastery of the basic alcills. 

- Standards should be locally determined. Therefore they 
should reflect and be sensitive to the community's concerns. 
Input should be sought from representatives qf all affected 
and interested groups in the cbninunity. 

- The process of setting standards is new- for most districts, 
so allow for mistakes. Standards should be reviewed every * 
year. If standards are going to be made more stringent fee 
sure to give sufficient notice to affected students and 
parents. 

Types of Judgements 

There are four ways of obtaining judgements to arrive at au 

standard . ^ 

♦ ' ' ' 

- Judgement "uncontaminated by data" ♦ 

- vTUdgement based on inspection of the instrument 

- Judgement based on ex2anination of student performance 

- Judgementj^ based on both inspection of th% instrument and 
examination of performance data. • 

Unfortunately the first procedure is the one most frequently used 

and most difficult to defend. Examples include the historical reliance 
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on ^0% correct ns "juaasing'* without reference to the best or the 

'' '«'•■'' 

population". Similarly y standards set arbitrarllV high without refor- 

■ ■ . ■ ■ . ■ ■■. V ■ . . 

once to either the test or -stut^nt in order to appease a board member' 

or "lodk tough" tfo competing schools are on sh^y ground,' 

, ■ ■ J - 

• X ■ • ■ / ■ . \ : 

_._ Th«-»ocond-kind -Of- -judqement-'-atem-revlew)-takes-into- account 

stweriil test variables including test content, appropriateness of objec- 
tive.s, and item difficulty. 'Direct inspection 6t the test, item-by-item, 
generally is made 'by a group of "experts", pedple who are familiar with 
the institutional and test objectives and knowledgeable about the test 
content-. * ^ 

The third set. of judqemQnts (performance-based) depends on how 
students porform on a test. In the simplest method, students are ranked 
and selected either from the top down or bottom up depending on how many 
can ,b'o accommodated. Performances-based methods can be used in a predic- 
tive sense as. well normative sense. When judgements about the 
students;* mastery nf a subject are collected froin knowledgeable people, ; 
standards can be set to reduce the likli>iood of making classification 
errors . ^ 



Both item-review and per forman^^e . important fac.tors if one is 
to make ^reasonable and fair judgements. The weakness of either approach 

' ■ ■ , - ,\ ^ .. 

alone is greatest when th^ judges lose touch with the interrelationships 
bf the factors. In using th«L^ methods described here, it is important that 
judges not make decisions In a vacuum but keep in mind all the linkage^ 
between tests, student performance, instruction and district objectives, 

\ ■■ ■ V 

Finally, standards obtnined by any of these 'methods aire not absolute 

\ .V .. ' • ■ 

decisions. They should be treated as recommendations. A final adjust- 



ment maV be necessary by a revieW group «r the i^ch6ol' committee . 

I 



Do 



General Preparation for a Standard Setting 
Session Using Item-Review Methods 



•Identify and Select Judges: 

The grade level committee might itself serve as the panel of judge 
PT4o^Jto_the vRDrk se^^ _v^ich_ the^_atandar^- setting— judgements are 

to be made, the facilitator should make the following preparations: * 

- Obtain. enough copies of each test to be able to distribute one 
to each 'judge. (An overhead projector can be used, but it is 
better if judges have their oiyn copy too.) 

- Prepare enough copies of the Judge's Recording Forms for each 
judge (if more th&n one test is being inspected, confusion of 
paj6er shuffling can be reduced by duplicating the f»rms on 
differ^pnt colored paper for each different test.) 

- Make enough practice sheets for all of the judges. 

HaVe copies of the district '.s definition of minimal comf^tence 
mado for each judge. \ 

\ ^' w 

- Arrange for a comfortable meeting room with sufficient tat^^e 

or d^sk space. for the judges. 

- Arrange for someqjne to assist you at the meeting. 

- Obtain one copy of the technical manual and/or printout of 
dat^a on item difficulty and typical studeiTt 'performance . 
Also have a copy of the answer key. 

/ 



■Si 
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The- NedeXaky Method (Method B 



) 



The Nedelsky Method irequires a group of judges to iMUtiew a teat and 
maR* a decision for each question on how many' wrong alt^ernatives a mini- 
mally qualified student would be expected to eliminate as being obviously 
wrong. The number of alternatives remaining constitutes the set | from which 
that student is expected to guess. -In this way each judge assesses the 

r 

difficulty of every item. The overall difficulty (or standard) of the, test 
is the averaged judged^if f iculty of all items. The procedure can be used 

« 

only with multiple-choice tests. 

The ^critical Elements in ^determining a standard with the Nedelsky 
Method rest primarily ^n^ the selection of representative judges and reaching 
an understanding and agreement on what. is meant by the "minimally competent" 
student/ 

. It Is rGcommended that^between 7 and 9 judges be used with th^ 
. Nedelsky Method, Factors to consider in selecting comml^ttees a:nd judges 
are discussved elsewhere. 

In defining the minimally competent, or just barely passing, studept 
it may help to describe characteristics of such students from one's own 
experience and create a composite hypothetical profile as a model for 
discussion w1\t'h other judges. Sometimes it is helpful to state what such 
a student is and is not like. -For instance, 



) 



The minimally competent High school graduate generally is not 
a college bound student, 

*^ . ' 

S \ ■ 

- The diff^ence between the "average? high school graduate and 
the minimally competent graduate mfliy be as qreat as the diffpr- 
ence between "that average graduate and the brightest student 
getting a scholarship to a selective university. 

- The minimally coinpetent high echopl graduate is like ( a locally 
known person or occupatlcai ) who works as a ( eome appropriate 
occupation ) at ( a local shop or congpany ) . 
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One source of confusion in defining this mythical student^ 
.abilities sometimes arises during the coutse of the Nedelsky procedure. 
Th^ difference betwen what this student "should" be atUe to do and what T 
this student ••could" do can be difficult to resolve. For some judges, 
there is a tendency to expect all students ••shouW be able to get all^ the 
questions correct. For other judges, even many competent students 



v"cx>uldn'h correctly answer many of the questions. The standards need 
' to be realistic and reflect the content of instruction as it exists 
for the students. Yet, if there is dissatisfaction with the present 
standards, itore might be expected of thi^ students. These issues 
' should be raised during the standard setting session. '|f;ven though every- 
one may not be in complete agreement it is important that the various 
views be presented and discussed. 



Instr ucting the judges how to review the test items . 

- ^Review with the judges the purpose of t^e tests and the standard 

netting exercise including presentation and discussion of the 
district's definition of minimal competence. The definition ^^Y 
need elaboration or better description. The problems may become 
clearer once the items are under review.- Be sure to make a dis- 
tinction between average performance' and minimal performance. 
Allow 3 to 4 hours to review an a>terage l^gthr test (75 items)-. 

Distribute practice questions to judges. 
Describe the judges' task; > 

r 

The Nedelsky Method of standard setting requires a group of 
knowledgeable judges to inspect each question in a^ multiple-- 
choice test^and make a judgement about each wrong •alternative • 
Each judge must decide whether a hypothetical student who 
just barely meets the district's definition of minimal compe- 
tence could be expected to eliminate the wrong alternatives. 
. % 

- After the task 'is clear to the judges > briefly discuss the 
rationale for eliminating some alternatives and not others. 
Pass out the test booklets to the judges. Begin discussion 
with the first question. Ask how many of the judges think 
that the first wrong alternative vrould be eliminated by the 
minimally competent student. How itjany disagree. 

. ■ 2i) 
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- ' For each wrong alternative that the ^roup of judges does not 
unanimously agree upon, ask one judge from each viewpoint in 
turry to briefly explain his/her reasons. The. purpose of such 
an exchange is not to force consensus but to allow* different 
points of view to be heard from the group. Judges may change 
their minds aftew: hearihg the two or more different reasons. 
Once all of the vrong alternatives have been reviewed in this 
way, ask the judges to circle the number of alternativea they 
personally think that a minimally competent student should be 
able to eliminate as wrong answers. 

Go- through-each queation~on~th^~t"e8t" lh~the"l*^^^ 
above. There yill be a great deal of discussion at the 
beginning of the session. Later on, the reasons for disagree- 
ment generally will be the same as those already aired . 

- During the review of the first several questions, circulate 
♦ around the room t;D make sure the judges are aircling their 

forma correctly. 

- W|jjer;*all test items have been reviewed, ask the* judges to ^ 
tally up each column on^ their fobms. Double check addition 

"^'H^ summing together thja column totals to make sure it equals 
the tot^l number of questions, as snown on page 27. 

- To calculate the standard, transfer the column ' totals 

to the corresponding probability and multiply. The sum of 
those multiplications is that judge's standard estimate. 
^ Average all of the judges' estimates to obtain the recom- 
mended group standard. 

Thc^ iudqemonts should be realistic. Hopefully the test has already 
been given to some defined set of students and item difficulties (p-values) 
are available from either the district's ovm data or a technica^^. manual v^' 
Pe^riodiccil ly monitor the judges as they raise their hands on each wrong 
alternative. A difficulty index can be'q)iickly calculated for an itefn 
by using the probabilities on the recording forms. If the judges' expec- 
tations consistent ly exceed the average performance of a comparable pop- 
ulation of students, the standardjn^st likely will be unrealistically 
high. In such a case remind the judges of the purpose pf the test and 
possible consequences (e.g., do they really think that 50% of the students 
do not meet minimum graduation requirements) . 
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Examplt of forms filltd out by ^ 
three judqes^ for • 10-item test 



Judoes Recording Form 
(Nedelsky Method)' 



Ouestion 
Number 

1 
2 
3 
4 

5 

6- 
7 
8 
9 
10 

TOTAL 



Circle i lumber of 
Choices Identified 



0 

0 
6 

„0 
0 
0 



O 2 
1 2 
1 2 

CP 2- 

1 h 



0 1 2 (2^ 

A ± ± W 



Question Circle Number of 
Number Choices Identified 



TITdqe; ^ { 



3 


Total 


O's 


X 0.25 • 


3 


Total 


I's 


X 0.33 ■ 


3 


Total 


2's 


X 0.50 ^ 




Total 


3's 


X 1.00 • 


3 . A> 






















% 

















X .25 
" X .33 

X .50 
'x 1.00 

-SUM 



Judge: 



1.00 



1 


0 


1 


' 2 


0) 


2 


0 


? 


2 


3 


3 . * 


0 




(2> 


3 


.4 


0 


1 


2 




5 
6 


0 

• 0 


? 




3 


7 


0 ■ 


1 




3 


8 


0 


1 




3 


9 


0 


1 




CD 


10 




A 


(5) 


_i 


TOTAL 


o 




r 


3 



Question 
NufDber 

1 

2 

* 3 
4 

5 
6 
7 
8 
9 
10 

TOTAL 



Ci rcle number of 
Choices Identi f ied 



0 
0 
0 
0 



0 
0 
0 
0 



3 
3 

3 
3 
3 
3 

i> 



Total 
Total 
Total 
Total 



O.'s 
I's 
2's 
3*s 



(io) 



0.25 
0.33 
0.50 
1.00 



X .25 
X .33 
X .50 
X 1.00 

r 

SUM 



Judge: "^3 



Total O's X 0.25 - 

Total I's X 0.33 - 

Total 2's X 0.50 - 

.Total 3's X 1.00 - 



_ X .25 
X . 33 
" X .50 
'x 1.00" 

SUM 



31 



o 
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• •as* 



■ 0*1 cowputt tht cut-off score for this 10-item ttU. take the averaoe of 
ERlQ rtf Jwdgts* SUMS. ^ 
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SAnplt Judgt'a Recording Form^(N«dtltky N«thod 
fo^ « 75 Item, 4-«lt«rn«tiv« nultlpl* cholp* tM 

. 





Circle 


Number 


of 




Clrclf 


j-Nuinber 


■of 


NlitiiiK A V* 

(1 MBit' V L 


Choice* 


Identified 




Cnolcti 


\ Identified 


1 




X 


I 


J 


39 


0 ] 


2 


3 


2 




1 




J 


AO 


0 ] 


2 


3 


"\ 

J 


U 


1 
I 


2 


3 


^l 


0 . ] 


2 


3 


A 
H 


U 


1 
1 


z 


3 


^2 


0 1 


2 


3 


s 


A 


1 


<> 




jt-^ — - 








J 


U 


1 


z 


3 


43 


p- J 


2 


"3 




U 


I 


Z 


3 




0 1 


2 


3 


7 


U 


•1 


z 


3 


45' 


0 1 


2 


3 


o 
o 


0 


I 


z 


3 




0 1 


2 


3 




0 


1 


2 


3 


47 


0 1 


2 


3 


1 u 


0 


1 


2 


3 


48 


0 1 


2 


3 


1 i 


U 


1 

1 


2 


3 


49 


0 1 


2 


3 




0 


1 


2 


3 


50 


0 1 


2 


3 


i J 


0 


1 


2 


3 


51 


0 1 


2 


3 


1 L 

1 H 


0 


I 


2 


3 


52 


0 1 


2 


3 




0 


1 


2 


3 


53 


0 1 


2 


3. 




0 


I 


z 


3 


\ 54 


0 1 


2 


3 


1 7 


U 


1' 

1 


*> 

z 


J 


55 


0 1 


2 


3 


1 ft 


0 


I 


2 


3 


56 


0 1 


2 


3 


1 0 


U 


^ i 


z ^ 




57 


0- 1 


2 


3 




u 




Z 




c o 

58 


0 ' 1 


2 


3 


P 1 
%. 1 


\) 


1 


*> 

z 


i 


59 


0- 1 


2 


3 




n 
u 


1 


*> 

z 


J 


zn 

Z 1 

61 


0 1 


2 






u 


i 


z 


J 


0 1 


2 


3 * 




r\ 
u 


1 


*> 

z 


J 


z o 

62 


0 1 


2 


3 




0 


1 


• 2 


3 


Z 'i 

63 


0 1 


2 






0 


i 


2 


3 


kh 


• 0 1 


2 


3 


2 7 


0 


1 


2 


3 


65- ' 


0 1 


2 






0 


1 


2. 


3 ; 


66 


0 1 


2 


\ 


29 


0 


1 


2 


3 , 


67 


0 1 


2 


3 


30 


0 


1 


2 


3 ■ 


68 


0 i 


2 


3 


31 


0 


1 


2 


3 


69 


0 1 


2 


3 


32 


0 


1 


2 * 


3 


'70 


0 1 


2 


3 


33 


0 


1 


2 


3 


71 


0 1 


2 


3 


34 


0 


1 


2 


3 


72 


0 1 


2 


3 


35 


. ' 0 


1 


2 


3 


73 


0 1 


2 ' 


3 


36 


0 


1 


2 


3 


74 


0 ' 1 


2 


3 


37 


0 


1 


2 


3 


75 


0 1 


2 


3 


38 


. 0 


1_ 


2 


3 














« 






Subtotal 








Subtotal 



















TOTAL ■ 



Totajl O's X 0.25 - 
Total l'« X 0.33 - 
Total 2' f X 0.50 • 
Total 3'e x 1.0 - 

SUN 



32 
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Ntdttltky Mtthod 



1- 



2, 



3. 



Proc«dut« Is Independent of 
nu«btrs of students tsklng the 
test. Cut-off csn be cslculsted 
for v^ry inali gf ovips bf a tu- "~ 
dents. _ 

Procedure csn sccpmrnodate parti- 
cipstion by s broad cross-'Section 
of cottinunity experts as Judges 
(e.g., teachers, sdmlnls trstors , 
parents, students). 

Procedure ijB based on close 
scrutiny o^^items in the 
instrument.^^ 



: closely follov 
ssses of tMt 
iltcmativei^for 



Procedure most closely fallows 
decision procei 
takers, each a] 

each item must be rejected or 
accepted. 



4 



plaadvantnges 



1. Procedure is blincL to actual" 
student performance on test. 

2. Cut--of f can be too high or too- 
low when the number ef Judges 
with the same special interest 
or bias ere disproportionately 
represented. 

3. When different forms or teats 

* are used that are not eqjuated, 
the procedure must be reputed 
for each form or t^Hit. 

A. More time and people are needed 
to make Judgments than with ^ 
performance based procedures. 

5. Can only be used with multiple- 
choice test. 




Unless one counts the test administration, scoring, etc., involved in 
the contrasting groups approach. 



' Coatr*«ting Groupn Mathod (Method A) 

♦ 

i • ' . ' 

rh% contrasting ^t>\ji]>* Method requires judgtroenta about th^ students 
who will take the test rath«ir than j\id^ements about the instrument itself 



The Aethod assumes that there are three distinguishable groups of 

students in the sehool population. These groups were described' at the 

beginblng of this chapter as "non-masters", "borderline" and "masters" 

of the district'defined basic skills. The best a priori and independent 

judgement of which student can be best classified in which group can be 

made by a teacher who has been teaching the student in the skill area 

long enough to be reasonably certain of that student's achievements 

Several conditions are necessary to obtain valid teacher* judgements. - 

- Judgements must be made on the basis of the student • s , achieve- 
ment in the basic skills not on the ^student ' s attitude, 
attendance or other behavioral problems. A student's mastery 
of a basic skill often' may be difficult to isolate from these 
variables. Scorefe from such students, as well as recent 
transfers, should not be used in calculating the standard. 

~ The judgements Should be made by teachers who know the student "a^ 
ajcills with respect to the. test content- For exan^Je, math 
teachers should judge students for .the tbath test and English 
teachers should judge reading and writing. E)epending on the 
course structure and content, others such as social studies ' 
teachers may be able ^o make perfectly a<j^equate classifications. 
Even math and English -teachers who are teaching higher level 
courses (e.g. , algebra and literature) may have difficulty 
focusing their judgements on the bas^c level of mastery. 

^ \^he district's definition of mastery or minimal competence in 
the skill area should be clear to the teachers. The purposes 
of the test and reason for collecting their judgement should" 
also be clear. 



- Judgements inuit be baaed on the students' present achievement. 
Judgements about a student's performance that are even a few 
months old may not be accui^'ate indicators of what the student 
has retained or has learned subsequehtly. 

- Judgements must be mad< independent of the test scores, i.e., 
without knowledge of how the students actually performed on 
the proficiency tisst* 



f 

E 
a 
Z 



The standard obtained with the Contrasting (Sroups Method is based 

■ . . V ■ ■ - ^^ ■■ . - , 

or> the teat performance of two groups of ) students identified by knowledge- 

/' . ' ■ 

able judges. Judgements made by teachers independent from the test scores 

it 

classify the students into those who are clearly masters of the skill and 
those who, are clearly not masters of the skill. Scores from students who 
cannot be classified into either of those groups are not ased in calcula- 
ting the standard. The standar|/ is placed generally at tihe^point where 
the two distributions of scores for '^masters" and "hon-masters" intersect 
as shown below. This is the^ point where both types ^of classification 
errors can be held to\a minimum as discussed earlier in this chapter. 



Standard 




too 105 no 



lis ife 125 ^lo lis 140 145 150 ' 155 165 TtX l^f 1^5 



If possible, there should be at least 100 students in the district, 
who would be classified as "non-masters.'' If fewer than 100 students 



are in the above or below standard groups, the standard -proposed by the / 
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int»ri«ctlon of th« tvo di«trlbution« •hould b« vi«w«d with extr«m« 

c*utio|i. some attention •hould b« giv^n to th« m^Ana and standard * 

daviation* of these tWD group*, and more ■pecificallyto how a acore 

a.t the first standard deviation above the mean for the belov standard 

, group compares with a score at the first standard deviation below the 

"w^n f^r the above standard group. 

Procedurally the steps for collecting teacher judgdment^^'ar^ as 
follows : • 



Identify the students and classrooms for which appropriate 
judgements can be made. 

Obtain the class roster. 

- ^ave teachers who can make valid judgements about those students 
for each dkill area meet to explain procedure^ and become familiar 
with, the definition of what Is clearly a "master" and ^ "non-master" 
of . the district's bbjectives. 

- Have teachers make their judgements of the students they know and 
mark their rosters, for example, with a "1" next to those stuidgnts 
who are clearly mast;ers and a "3" next to those who clearly nee^ 

^ supplemental instruction. Any studept who is too close to the 

borderline or who presents problems in classification because of 
behavior, attendance, or who is not kriown by the teacher should be 
marked with a "2". . \ 

After the judgements have been collected and the test administer ed^ 
enter the test score data and the jUdgemieints on the data entry sheet. 



FRir 
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CSdntrtitlng Groups Mtthod 



/ 



Advnta^#» 



pliadvntag»s 



1. Proctdure la based on actual 
atudant performance data. 

2, ^Judgments basfd on teachers » who 

are knowladgeable about subject 
mat te t\and"s t udeh 1 8^; " 



3. 



Psychometrlcelly cleaner - 
errors'of classification are 
minimije.d and can be identi- 
fied by case-. 

Does not requir-e as much time 
to collect judgments as item- 
review procedures. 



1* For reliable calculations, 

should have about 100 studeqts 
in smallest of two groups. 

h „ No^di re^t_ Inp u t _ by af f e cte d_ _ 
constituencies except teachers 
of 'students being tested. 

3. May not be able to obtaii^ 
judgments for students who are 
not taking a course in the 
subject-matter being tested. 

4. Must test later in the year 
than with itfem-review proce- 
dures to allow teachers time* 
to know studMifs* abilities. 

5. If definitions of mastery and 
non'-mastery are not clear and 
uniformly applied by teachers 
there is a danger of mlsldentl^- 
ficiBition. Teacher judgment 
may not be made with respect 

to test or district's defini-- 
tion of minimal competence. 



/ 
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standard S«ttjLnq on Wr'itlng Sanqplai 

Proposed stimdardt on the Writing eaityple will be developed by 

the application of the cx^ntraetlng groups method to the students' 

_.yriting„ scores a^ soores reviewed -by-the grade 

level cjonunittee. A packet of scored essays with the scores removed 

will be provided to the appropriate grade, level committee to allow 

them to identify above and below standard papers in a way that 

would identify their proposed standard. This same packet will be 

ft 

made available to the advisory committee in its review of the 
proposed standards. 

Note: The contents of this Section were adapted from several 
working documents prepared by Educational Testing. Service includina- 
tj»a Manual for Setting Standards prepared by M. zleky and S. Livingston. 




? 
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Section 7 



Data Collection Procedures 4 

The data collection procedures in this study will result in various 
products which the local cU^trict will develop. The follbwing ts a list 
of the products to be develop)^d along with some comments on how tH^y 
can be developed. 



Products 

1) Lists of basic skill 
objectives in reading r 
writing and mathematics 
at three grade levels 

2) Initial list of tests to 
be considered at each of 
three grade levels 

3) Completed test review 
forms on one or more tests 
at each of the three grade 
levels 

/ 

4) Completed item-by-item review 
for standard getting for each 
objective test selected at 
each grade level 

5) Completed writing samples at 
• specific grade levels (grade 

8-9 at least) 

6) Writing samples coded (system^ 
school^ teacher codes) 

7) Roster lists of student 
scores cna writing sample 

8) Standardized test scores - 
reading, mathematics and, at 
some grade levels, possibly 

. writing (or language arts) 

9) Teaicher ratings of all regular 
students at the three grade 

* levels, identifying ^'masters" 
and "non ^masters" in reading 
writing f and mathematics 



Developed by 

grade level committees (or other 
curriculum cpommittees already 
established) 



the facilitator, working with 
grade level committees 



the grade level committees (the 
facilitator then orders the tests 
selected and arranges for the ad- 
ministration of the tests) * 

the grade level committees / 



adrnj^nlstered by classroom teachers 
and coordinated by facilitator 



clerical assistant to facllitatior 
(codes kept "confidential") 

classroom teachers 



test publisher or scoring service, 
following local administration 
of the tests 



a survey form (see Appendix G) com- 
pleted by all teachers ii) these 
subjects at the three grade levels. - 
(survey administration to be -qoordin- 
ated by the facilitator) 



ERIC 



3.9 



10) Completed Data Entry 
Sheets (See Appendix H) 
for all regular students 
at each of the three 
grade levels 



clerical assistant to facilitator 



The first nine ^products (#1-9) make possible the completion of 
product the c^ata entry sheet fo^r all of the regular students. On 

these-data- emry"'^ 
each student: 

a^tudent cod!& (names need not be include<?; apace is available for 
the name only for the convenience of t^e local staff) 

^ qradQ^ level ^. 

^ sex :^ 

minority group stijtud ^ 
status in reference to English or non-Engllish ^pSeaking 
most recent marks in reading, writing, mathematics 
test or writing sample scores in all three subjects ■ 

^teacher ratings in all three subjects 

For each grade level, a cover sheet will be required {iroviding in?or- 
matlon on the score data included on the data entvry form .(range, intervals, 
etc.) 

Figure 1 outlines a tentative schedule foj: the collection of data, 
assuming that the local effort will get underway in early March with testing 



in early May. Districts conducting their testing in the Fall would follow 
a somewhat similar schedule. These districts would collect data for the 
writing standards. according to the March-June schedule shown below. In 
the Fall, the other teacher ratings would be delayed unt^.1 November , allowing 
the teacher sufficient time to work with the students before rating' their 
needs for special work in basic skilL development. * 



Figur« li Tentative Schedule for Data Collection Activities 



Products 



1. Lists of Basic 

Skill Oljjectives > 

2. Initial Lists of 

Teats 



Week in 
March 
2nd 3rd 4th 



April 



3, ^ Test Reviews 

Completed 

4, Iteni^Review -Standards 
^ Coinpleted 

5, Writing Samples 

Comjpleted 

6. Writing Samples 

Coded 

7. Writing Score Roster 

(standard) 

8. Scores from Stand, 

test ^ 



•5 



I 



9/ Teacher Ratings 
Completed 

10. DAta Ent±y Sheet 
Completed 
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*^ Most of the tasks and rssuXtanf products listed above need 
-lifet-le or no comment in addition to what has been presented in earlier 

'sectioiis.** Two data collection tasks, the teacher rating survey and the 

I ^ . %' ■ 

coinpl#tion the data entry form do merit additioilal comment:. 



The teacher ratAg survey will require a matching of atuderjjbs with 

— thoafi_teachers -who-have- worked with- them in- reading or- writing-or i^ 

matics. In self contained classrooms, the one tea9her would rate each 
stAdent in all three skill areas. In a departmental or team arrangement, 
tne circulation of copies of the class roster (one for each teacher) , 
with space for ratings in all three subjects (See Appendix G) would 
enable each teactier to submit ratings in the appropriate subject areas 
x^without being inf-luenced by the ratings assigned to these same students 
by other teachers. A less desirable alternative would be the circula- 
tion of one class roster list with teachers indicating all three ratings 
on the same list. 

The final step in the data collection^ process is the completion of 
the data entry form described abpve. These data entry sheets could be 
filled in gradually with data entered as they become available. The 
school marks used in this study could be those from the previous semester, 
i.f the use of current semester marks would unduly delay the process. 
These marks are included simply to givb some additional information on 
'how a proposed standard affects "A" students, "B" students, "C" students, 
etc. The assumption here i's that, on the whole, marks do not fluctuate 
substantially from -one semester to the next, despite individual ups 
- arid downs. In completing the data entry form, it is essential that the 
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format b« followed •xactly . Th« data are k«y-pxmch«d directly from 
thaa* forma into a atandard computar program. Tha complatad data 



forma will b« collactad by ETS in the laat waak of JunaV frira thosa 
districts on the March-June achedula. 



I3 
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f ' ' - -40- 

,1 . 

Mport Int«zpr«tation * 



In aoiM way«, th« n«w stat* r»quir«m«nt« ar« not til that n«w. Baaic 
•kill* tmprovaaant has baen a primary yoal of ■choolihg f rem ^ha aarliaat daya. 
With tpha Elamantary and Sac6ndary School Act of 1965, formal proyrama auch 

5 aa Titla I programa, for atudanta in naad of apacial aaaiatanca, hava baan 
much in avldanca in moat i^hoola. For many pf thaaa programa, particular 

• lavalfl of attainment ort variQu* taata hava baan uaad to guida daciaiona 
on atudant placement into thearf programa. While the praaent baaic akilla 
trnprovement policy requires, in effect,* similar screenirig for placement purposes, 
\ the con^xt of this new requirement adds a note of accountability to local 
standard setting. For this reason, more formal attention- to standard 
setting is called for. With this new requirement, the local standard 
publicly defines the expectations of the local school pystem, in ways 
that Title I entry level requirements never did. For these reasons, the 
school staff and community representatives must work together. to establish 
the perf o'rmance standards. 

r 

One majoir task of the project facilitator ia to work with the ayatem-wide 
adviaory committee, using the MEC-ETS atandard satting atudy report, to 
^ formulate performance standards to"^ propoaed to the school committee. \ 
draft copy of the report, with data from a fictitious school district, ia 
included in Appendix A. Section I of that report proposea two poaaiblw 
Standards in each of the three' skill areas at each of the- three grade levels and 
then discussQ^the impact of each of those proposed ^itai^ards. Section V of the 
report presents more detailed ana/ysis^of teacher ratings, test scores, and 
school marks in each skill area at each grade level, alon^ with information 
on the impact of propolied standards bn students by sex, race, and language status. 

.. . - ^ . 
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The etandarda to b« aat ar« indeed local atandardi, propoaed by the 
adviaory cowriittee anVeitabliahad finally by the school coninittee. the 
two standards proposi|^ in the MEC-ETS report are simply recomcnendations 
based on th« data presented. 

In reviewing these recoriftendations, the advisory conanittee might find 

the following questions useful- for purposes of-discussion; 

o What is the impact of each proposed standard in terms of th^^er- 
centage of students falling below? Is this reasonable for this 
community? (For exan\ple, a community which perceived itself as 
having a serious problem with basic skill development might find 
a standard at the 25th percentile of local performance more 
acl^{)table than one at the 5th percentile,) ^ 
o What is the impact of each proposed standard on students who 
received "A's" last semester? "B's"? "C'8"?etc. V 
o What i^ind of remedial program , would prove feaiible given present ' 
and anticipated resources? Whiah of the proposed standards is most 
feasible in this regard? 
o Should one standard be adopted for the present and a higher ("goal") 
standard scheduled to go intb effect in three to four years? 
<N o How should the local standards relate to the national or fl(tate 
"average" (50th percenti le) ? 
Standard setting is in the f inal^^alysis a matter of ^dgement. 
Informed judgement, however, is always to b^ prefereed to casual judgement. 
The approach taken here allows the local committee to approach the decision 
with as much information as reasonably can be brought to bear on the decisio 
Whatever decision the committer makes, the standard recommended and 
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finally establ^ohed should r«l«t« to tomtt pertinent infterma^i^on, going 
beyond the iiwned Fate appeal of certain numbers (iuch a« 70 peicent or 



80 percent* correct) . 
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The state requires the reporting of t^ number of students by sex, 
race, and language background who fall below. the standard. All of the 

- procedures-used- in~the MEC^ETS standard-^ett'ijig Wu^^^^ 
group, not sub-group data. No bias for or against any sub-group has 
been introduced by these methods. Some might. argue thafsome possibility 
^of bias is inherent in mathematics and in the reading and writing of 
standard English. Any consideration of ^blas must distinguish between 
the possible bias In the requirement itself and bias in the manner- in 
which the requirement is met. S^n this latt^ regard, there are two 
areas in which local districts should make certain they are free from 
any bias. One is in the selection of the tests used and the ^her in 
the setting of the standard. 

All tests used should be screened for sex, racial, or other kinds 

of bias by a careful review of the contents of the tests themselves.^ 
(For additional information, see Appendix K. ) 

.Th* ifctandards established by the impartial procedures described 
above should be fair and unbiased. In reviewing the options provided 
by these procedures, the locAl advisory conttnittftiEt^^ take into 
^count the impact on various sub-groups of any proposed standards. 
This should not be construed «8 a recommendation that standards neces- 
sarily be lowered to aiccommodate «my sub-group. Becaufi^^e the standard 

1 ^ 

Where needed, item analysis data by sub-group might be examined to 
show the test "works" the same way for each sub-group. 
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limply d^finai thm number of »tud#nti who will rectiva •pacial 
attention" in the developinent of their basic •kills, higher etandarde 
are not necessarily disadvanta'geous to a group that has difficulty with 



the requirement. In planning subi 



4. 



nt learning activities, attentfion 



must be given to amy segregative effect a particular program might 



inadvertently introduce • 



vApp«ndlx A 

m. 



Draft, of MBC-rrs Standtrd Setting Study Report 
to the A dvi ■brv Coaitltt^ 

Introduction - Wt^ thin kind of etudy? 

f 



The 



echoole h*ye ^ad etanderde for yeare. These 



standards have been embodied iri day to day teacher judgements, in 
schools |uirks, and in promotion/retention policies, to name but 

[ ' \: - • - ~~ 

several %f the ways in which' schools maintain standards. The January 
1979 decree of the state Board required each district to set explicit 
• performance standards on basic skills tests at three grade levels. 
As used in this context, a performance standard is the minimum 
acceptable score on a basic skills test. While the implicit 
standards ht^ve been in effect for years, the setting of explicit 
performance standards is a new activity. 

As school districts approach this new activity, they can choose 
between two possible approaches to setting standards. One approach' 
assumes that in this business of setting standards there is "really 
nothing to it". The other approach calls for a standard setting 

i 

'study, • 

« 

I. 

The "really nothing to iti approach involves a committee (or an 
individual)- simply selecting a performance standard that they think 
looks reasonable. For example, they might set as a standard, 
80 percent correct on any basic skills test they use. • If they 
are using a test with local norms they might select th* 30th 
percentile (12th grpde) for their standard. The standards set 
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by this rather caemal proce»i coul/d turn out to quit* fair und 
appropriAta. They cOiiia alao t;urn' out to be quita unfair to tha 
•tudanta* and school'* reputation, TTiis would happen, for example, 
if the tests used were «o difficult that 50% correct would really 
prove to be the reasonable atandlrd. In aome schools, students 

- below the- 30th-percent ile could-be wel l- above-fflinlmum" itlindsrds ; 

^ in other schools, students at the 45th percentile might be well 
below acceptable standards* While the "really nothing to it" 
approach%an, at times, work well, it can also work out badly. 
The chief problem ^ith this approach is that (he standards set 
by tH^s process are almost impossible to defend in the face of 
any kind of challenge. Casual judgement is difficult to defend. 



The 



, school committee has chosen the standard setting 

study approach which bases standard setting on. information about 
the minimally qualified student and the difficulty level of the 
teats on which the standards are established. This approach also 
takes into account the impact of these performance standards in 
terms of the numbers of students above and below the standard, the 
relationship between these s^tandards and school marks, and in a 
general way, the relationship between these startdarda and those 
being considered by neighboring distrljcts. This information will 

provide the basis for decision in, setting standards 

Indeed, all standard setting is a matter of judgement • According 
to the Stat* Board policy, the judgement involved in the state 
required standard ^tting in basic skills must be local judgement, 
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ultimately the judgement of the •chool comroittee. Thi« local judgement 
will be advantaged by well organised, relevant information provided 
by this standard setting study. Judgement based on careful sti»dy 
can be rfeadily defended.* 



Standard getting ^tudy 



This report is deal-gned to provide information to be used by the 

^ advisory coimnittee in formulating the specific 

performance standards it will propose to the ■ . . School 
Committee. This report presents proposed peYfof^ance standard! 
in reading, writing, and mathematics at the three grade levels, 

grades , and , selected by the school 

Committee. This report includes the following five sections^ 

1) proj)osed performance s^anc^ards for 

2) >xn overview of the 1979 state requirements 

3) the rationale for the tests used in this study 

4) the rationale for the standard-setting procedures ^^^M^ 
In this study 

detailed Information in support of the proposed standards 

This report has been prepared by the Merrimack Education Center (MEG) 
with assistance from the New Englan^ Office of Educational Testing 
Service (ETS) for use by the district-wide advisory committee in 



* For example, the January 1978 decision of the U.S. Supreme 
Court upheld the teacher cettiflcatlon standards jiet on the 
National Teacher Examinations by the state of South Curolina. 



drafting th« itandard* it will propoM for th« School 

Coiwlttte.- In «n appendix to thi« r«port, two" •ampl. r.port format. 
ar« included, a format for tha advisory committea'a raport to the 
•chool colMftitte^ and a tformat for the final report of the 



School Cownittee in which the conwi'ttee formally eeta specific 

. • ■ * ' - 

-perfoniyinee-«tandard«T- Theae- report f6rmat¥ KaWbeeh""d^^^ 

Simply to expedite the work of these conmittees. • * 



SECTION I 
Propoaea Performance Standiirdp 

This section of the report presents the proposed pe;rformance 

standards for in reading, writing, and mathematics 

for grades , and _ based on the standard-settiag studies 

conducted in cooperation wi'th MEC and ETS. (A descriptHon and 

rationale for this study is presented in Section 4. The selection 

of the tests to which the ^timlhards are related is d^scribtfd in 

Section 3.) In presenting the proposed standards, -the foUolin'g" 

informafeion will be provided for each standard. 

the standard (a score on a given test or exercise) 

^ — the method used in arriving at this standard 

the national /or state) percentile equivalent (where 
avallabie) ,. 

. the number of and peroent of, students at or above the standard 

. the number and percent of A, B, and D students at or 
above the standard (where available) 

. the relationship between the proposed standard arj^ corresponding 
standards proposed by MEC member districts (wKe^e available) 



cowm«nt« on cl«««if Ication and mi»-cl««fi flection i«tu«a 



To preserve the complete autonomy of the conmiittee, 

this MEC-ETS report will not go beyond the presentation of the 



relevant information described* above. 

\ i ■ 



Where possible, two standards are proposed for each test at 6ach 
grade level, a Method A And a Method B standard. In this 'st^idy ,' 
teachers were asked to identify those ■ stu^tenta who definitely wer«" 
in need of remediation in basic' skills in mathematics (below 
standard) and those students wha were dfefinitel? not in need of 
such ass^iatance (above standard). A comparison between the scores 



of these two contrasting gfoups on thte. " teffC=^ pFO- ' 

duced the standard reportjsd here the Method A standard. Teachers 
were also asked to revl-ew y^e items in the test and estimate the 
perfo^nce on those items of minimally qualified students. This 
produced the standard reported here. a» the Method B standard. ' 



iPropoied Standards - Or«d« _2. , Rv<5i"9 . . 

At grad#_ , th# f tt wai^Ml^cted as an appropriate^ 

maaaura of basic aKilla Irx reading On thla taat (Laval , 

Fonfr^ . ) r the Method A proposed standard is a scaled scora of / , 
which is at the - % ile of national performince (grade , Spring) • 

" A t g rad e"^;;;^^^^^ 
or abov^this ttandard. Among A students 'in' reading , percent 

were «St»ve the standards aa were percent of the B students , 

percent ofVhe C students and jiercftnt of the D students. In ' 

comp^rliion with etan^^^rds proposed by the majority^f the other 
MEC districts, this standard fell (within, above, or below) the 
range of common 1^ propo^ed^T in comparison to the total range of * 
standards proposed, this standard fell within, above, or below the 
range. ^ In these comparisons the correspohdirtg national percentile 
jfcores were used as aj rough basis for comparison. These percentiles 
describe the performance of separate but allegedly similar national 
norm groups on different basic skills tests* 

In reviewing the effectiveness of Method A in tJiis instance, 

it should be noted that percent of the students were mis- 

classified as^maaters and perceht as non-masters. The proposed 

Method A standard does, however ^ fall between one standard deviation 



below the meani^f the above standard group and one standard deviation 
abo^e the mean of the below standard groups indicating that the more 
typical master* and non-masters are accurately classified. • 



Th« .Mtthod B proposed •tandard is . a •oaltd soor* of ' : , which ii 
tha of rtational parformanca (grada , Spring) . At 

grada studanta or parcant cff tha total nuna>ar vara at or 

abova thia atandard. Aiaong A atudanta in raading , parcant. 

wera above the atandard aa ware parcant of the B atudents/ - 

- parcant of the G" a tuden ta -and r — p e joant of the D atudentsv In 
coinpariaon with standards proposed by the majority of the other 
MEC districts, this^standard fell (within, above, or below) the 
ra»ge of conmohly pt"opo8ed. In comparison to the total range of 
standards proposed, this standard fell within/ above, or below the 
range. in these comparisons the corresponding national percentile 
scores were used as a rough basis for comparison. These pe^entiles 
describe the performance of separate but allegedl;^ similar national^ 
norm groups on different basic skills tests. 

In comparing the Method B standard to the Method A standard, the 

Method standard allows p ercent more students to be classifij 

at or above standard. ^ 



Prbioaid atandarda - Qr»d« 3 , Wri ting 

grada , tha ^ taat wa« aelactad aa an appropriata 

ft 

mtasurtt of basic «km» in writing On this f9t (L«vtl , 

Form )> th« M#thod A proposed ftandar^is a tcalad acort of ' y 

which is at tha _%ila of national performanca (grada , Spring) • 

At grade i tudahta or percent of the total" nuiin^ "mX ~ 

or above this standards Among A students in reading , percent 

were above the standard, as were percent of the B students, 

percent of the C students and p ercent of the D students. In 
comparison with standards proposed by the majority of the other 
MEC districts, this standard fell (within, above, or below) the 
range ^ coTWT»nly proposed. In comparison to the total range of 
standards proposed, this standard fell within, above, or below the 
range. In these comparisons the corresponding national percentile 
scores wlire used as a^ rp,ugh basis for compar*iaon. These percentiles 
describe the performance of se^Darate but allegedly similar national 
norm groups on different basic skills tfjjjt?. 

In reviewing the effectiveness of Method A in this instante, 
it should be noted that percent of the students were mis- 
classified as masters and percent as non-masters. The proposed 

• Method A standard does, however, fall between one standard deviation 
below the mean of the above standard <j^oup and one standard deviation 
above the mean of the below eta nda'W group^ .indicating that the more 

typical masters and noA-masters are accurately classified. 




-Th« Method B propoMd •t«nd«rd i« « soAl^d aoor* of , which i» 

iy^* of national p«rfonn«nc« (9rad« , Sprinfl) . At 

9r*d« , •tud«ckt» or p«rc«nt of th« total numbar w«r« «t or 

«bov« thi« atandard. Among A atudanta ^n writing , parcent 

__y«ra _abQyt _ the_«tai\dard aa wara parcant of tha B atudanta . 

parcent of the C «tudent» and parcant of tha 6 atudanta. In 

comparison with standards proposad by tha majority of tha other 
MEC districts, this* standard fell (within, above, or balow) th^ 
range of commonly proposed. In comparison to the total range of 
standards proposed, ; this, standard fell within, above, or below the 
range. In these comparisons fthe corresponding national percentile 
scores wer,e us6d as a rough basis for comparison. These percentiles 
describe the performance of separate Tout allegedly similar natipnal 
norm' gjtoups on different basic skills tests. 




In comparing the Method B standard to the Me'thod A standard, the 

M^thcxJ _ standard allows percent more students to be classified 

^ at or- above standard. 
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Proposed standard* - bi^«d«_^ , Nathanatlcs 

> . • _ _ 

At grada , tha t aat was aalactad aa an appropriata 

iMAsur* of bMisic skills in* mathematics . On thia taat (Laval 

Form J , tha Mathod A propdaad standard is a sca^ad scora of' , 

which is at the %ila of national performance (grade , Spring) • 

At grade , students or ^ percent of the total number wer^ at 

or above this standard • Among A students in mathematics , percent 

1 

were' above the standards as ware percent of the B studantSf > 

' s a 

percent of the C students and percent of the D students. In 

comparison with standards proposed by the majority of the other 
MEC districts, this standard fell (within, above, or below) the 
range of fcommonly proposed. In comparison to the total range of 
standards proposed, this standard fell within, above, or below the 
range. In these cbmparisons the corresponding national percentile 
scores were used as a rough basis for co'mparison. These percentiles 
describe the performance of separate but allegedly similar r^jpitional 

4 

norm groups on different basic skills tests, 

k 

In reviewin<5 the effectiveness of Method ft' in this, instance, 

it should be noted that percent of the students were tnis- 

classified as masters and percent as non-masters. The proposed 

Method A standard doe however, fall between, one standard ^deviation 
below the mean of the above standard group and one standard deviation 
above the mean of the below vptandard group^ indicating that the more 
typical masters and non-mastari^ are accurately classified. 



Th« M«thod B propo««d itandard la a acalad aoora of , which ia 

tha %ila of national parformanca (grada , Spring) . At 

' . atudanta or percant of tha total nunbav vara at or 

abov« thia atandard. Among A atudanta Ir^ mathematical parcent 



ware above the atandard as were percent of the B atudanta, 

percent of the C students and percent of tha ,D students. In 

Vsmperison with standards pro'posed tha majority of* tha other 
MEC districts, this standard fell (within, above, or Below) th'e 
range of commonly proposed. In comparison to the tptad range of 
etandards proposed, this standard fell within, above, or below the 
range. In these comparisons the corresponding national percentile 
scores were used as a rough basia\ for comparison. These percentile! 
describe the performance of separa^eHbut allegedly\im'iijar national 
norm groups on different basic skills testa. 

■J ■ 

In comparing the Method B star^rd to the Method A standard, the 

Method st»ndard allows percent mora students to be classified 

at or above standard. 



»ropoa«d standards - Gr«d« _g_^ , Reading 

At grada , tha_ t aat waa aalactad aa an approprlAta 

maaaura of baaic akllla in reading . Oh th^*U*aat (Laval , 
''o™ ),||he Method A'propoaad atandard ia a\acalad acora of , 

which ia at the ^ % ile of national performance (grade , Spring) . 
At grade , atudenta or percent of tha total number wef-e at 

I 

6r above this standard. Among A ttudents in reading , percent 

were above the standard, as vnere percent of the B atudenta, 

* ' """" 

percent of the c students and p ercent of the D students* In 

coinpari89n with standarAs proposed by the tnajority of the other 
MEC districts, this standard fell (withl^, above, or below) the 
range of ccmtmonly proposed. In pomparison to the total range of 
standards proposed ^ this standard fell within, above, or below the 
range. ifi these comparisons the corresponding national percentile 
scores were used as a rough basis for comparison. These percentiles 
describe the performance of separate but allegedly similar national 
norm groups on different basic skills tests. 

In reviewing the effectiveness of Method A in this instance, 
it should be noted that percent of the students were mis- 
classified as masters and . percent as hon-maatars. The proposed 

Method A 8tan(Sard does, however, fall between one atandard deviation 
below the mean of tha above standard group and one atandard deviation 
above the meaiH^of the below atandard groups indicating that the mora 
typical ma'atara and non-maatara ara accurately claaaiflad. 
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Th« -tuthod B propoi«d itandard is « aoal^d •oor* of \, which !• 

th« Ul« of r\«tion*l p#rfonn«nc« (gr«d« , Spring) . At 

, student* or p ront of the totel nu»ber were at or 

•bove this etanderd. Among A etudente in reading , percent 

were above the atandard aa were percent of the B etudenta, 

percen t "O f " the" C"atTrdent^ p ercent "of "tKe p Ttude^^ "j~ 

comparison with atandarda propoaed by the majority of the other 
MEC diatricta, thia atandard fell„ (*idthin, above, or below) tiie 
range of conwnonly proposed. In compariaon to the t^tal range of 
standards proposed, this standard fell within, above, or below the 
range. In these comparisons the corresponding- national percentile 
scores weire used ^s a rough basis for comparison. These percentiles 
describe the performance of separate but allegedly similar national * 
norm t^roups on different basic skills tests. 

In comparing the Method B standard to the Method a\ standard, the 

Method standard allows;, percent more students ^o'be classified 

at or above standard. V 



GO 



Proposed Standards - Gradsjg^ , Writing 

At 9r«d« , th«__ tast Wits ■•l«ot*d . «• an «ppx3PPri«t« 

aMia«ur« of basic skills irv writing . 6n this tsst (L«vsl , 
Form. ) , ths Method A proposed standard is a scalad scors of , 

which is at the % ile of national psrformance (grads , TSpring) . 

r ' 

9yj^*_rr~^L j^,",^*",^* ^.^ P«T.c«nt Pf .„ the total numbar w^^ 

or above this standard. Among A students in writing , percent 
w«re above the standard #a« %mre percent of the B atudenta, 
percent of the >C atudenta and p ercjftnt of the D etuden^s^^ln 

comparison with standards pro|x>sed by the majority of the other 

r 

MEC districts, this standard fell ^ (within, above, or below) the 
range of corrervonly proposed. * In comparison to the total range of 
standards proptosed, this standard fell within, above, or below the 
range. In these comparisons the corresponding national perpentile ^ 

•scoreff were used as a rough babis for compar^on. These percentiles 
describe the performance of separate but allegedly similar national 

tnorm groups on different basic skills tests. 



In reviewing the effectiveness of Method A in this instances 
it should be noted that percent of the students were mis- 
classified as masters and percent as non-masters. The proposed 

Method A standard does# however, fall between one standard deviation 
below the mean of the above standard group and one standard deviation 
above the mean of the below standard group, indicating that the more 
typical masters and non-masters ate accurately classified. 
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Th* M«thod B p|ropos«d standard !• « •oalad soor* of , which It 

•t th« of national p«rfonMkno« (grada , Spring) . At 

grada ^ atudanta or p aroant of tha total nunbar wara at or 

abovtt this standard. Among A atudanta in writing , parcant 

wara abova tha atandard aa ware parcant of tha B atudanta, 

parcant_of tha _ t_ itudanta and ! p arcant of iha D atudwita- In ~ 

comparison with standards proposed by the majority of th^ other 
MEC districts, this standard fall (within, abova^ or below) the 
range of commonly propoaTed. In comparison to the total range of 
standards proposed, thia standard fell within, above, or below the 
range- In these compariaons the corresponding national percentile 
scores were used as a rough basis for comparison ♦ These percentiles 
describe ^the performance*^ of separate but allegedly similar national 
norm groups on different basic skills tests. 

r 

% 

In comparing the Method B standard to the Method A standard, the 

Method standard allows p ercent more students to be classified 

at or above standard. 
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*^ ■ * 

At gradm th4 t #at >mm a#l#ct)td ai art ippropriat* 

Masuttt of basic skills In mathesfattcs . On this tsst (L«vsl , 
Form } , ths Msthod A propossd' standard is a scalad scors of , 

which is at ths %il« of national performancs (grads , Spring) , 

~ At grade 7 students or -^ psrcsnt of ths~ total" n wsrs~at - 

or above this standard. Ampng A students in mathematics ,7 percent 

were above the standard/ as w*re percent of the B students, 

perceht of the C students and percent of the D students. In 

comparison with standards proposed by the majority of the other 
MEC districts, this standard fell (within, above^ or below) the 
range of comnvDnly proposed^ comparison to the totaF range of 
standards propo^e^> this stfandard fell within, above, or below the 
ranqe. In these comiwrisons the corresponding national percentile 
scores were used as a rough basis for comparison. These percentiles 
describe the performance of separate but allegedly similar national 
norm groups on different basic skills tests. 

In reviewing the effectiveness of Method A in this instance, 
it should be noted that percent of the students<*were mis- 

classified as masters and percent as non-masters* The pitoposed 

Method A standard does, however, fall between one standard deviation 
below the mean of tHe above standard group and one standard deviation 
aboVe the mean of the below standard groups indicating that the more 
typical masters and non-masters are accurately classified. 



thm Method B propo««d standard it a toaltd toora of , which i« 

at tha ^%ila of nationaj, parfoxroanca (grada , Spring). At 

grada . \ j atudanta or parcant of tha total nuxnbar vara at or 

abova thia standard. Aniopg A atudants in niithematics , parcant 

ware above the standard as were percent of tha B students, 

percent of the C students and percent pf the D students. In 



comparison with standards proposed by the majority of the other 
MEC districts, this standard fell (within, above, or below) the 
range of conmonly proposed • In coinparison to the total range of 
standards proposed, this standard fell within, above, or below the 
range* In these comparisons the correspondingr national percentile 
scores were used as a rough basj.8 for comparison. These percentiles 
escribe the performance of separate but allegedly similar national 
norm groups^on different basic skills tests. 



In comparing the Method B standard to the Method X standard, the 

Method standard allows percent more students to be claislfiec! 

at or above standard/ 
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Proposed St«nd«i^« ^ Cr*d« J[_ Reading 

At qr*d« , th» t m*t w«« sfltcti^ «• an apprppr.lat* 

iM«»ur« of basic skillB in reading On this tat t (Levi » 

Form ) , thm Mathod A proppaad standard i« a scaled scbra of 

which i« at the ■ lile of national performance (gred« , Spring) . 

At grade , atudentr or ptyctnt _of the ^otai number were at_ 

or above thia standard. Among A atudanta* in ^ reading , percent 

were above the standard/ aa wsre percent of the B studenta, 

percent of 'the G students and percent of the -D students. In 

comparison with standards proposed by the majority of the other 
MEC districts, this standard fell (within, above, or below) the 
range of coiwnonly proposed ♦ ^Iri comparison to the \:otal range of 
standards proposed, this standard fell within, above, or below the 
range. In these comparisons the corresponding national percentile 
scores were used a« a rough basis fbr comparison* These percentiles 
describe the performance of separate but allegedly similar national 
norm groups on different basic skills testa. 

In reviewing the effectiveness of Method A In this instance, 
it should be noted that percent of the students were mis- 
classified as masters and percent as 'non-mastera. The proposed 

Method A standard does, however fall between one standard deviation 
below the 'mean of the above sta^ndard group and one standard deviation 
above the mean of the below standard group^ indicating that the more 
typical masters and non-maaters are accurately classified. 



Th« M«thod B proposed Mtandard it « soalsd ai6or« of , which it 

•t thm of nation* Vp^rformanot (qrmdf , Spring) , At ♦ 

qrm6B ; ^ •tudants or parcant of thm total nuBik>ar vara at or 

#bova thia atandard. Among A atudant|f in reading , p arcant 

ware abova the atandard aa vara parcant of ^ tha B atudanta, 

per cent of the C atudanty and P^^^f^^*^ tha P jitudanta, ^n 

comparison with atandarda proposed by the niaj^ity oF the father 
MEC districts, this standard fell (within, above, or below) the 
range of commonly proposed^ In comparison to the total range of 
standards proposed, this standard fell wid[iin, abova, or below the 
range* In these comparisons the corre*ponding national percentile 
scores were used as a rough basis for comparison. Thesfr E>ercentiles 
describe the performance of separate but allegedly similar national 
norm groups on different basic skills tests. 



In comparing the Method B standard to^ the Method A standard; the 

Method standard allows p ercent more students to be claasified 

at or above standard* 
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Proj)o««d , standard! - Gr«d« Jt_ , M*th«m«^ic« - 

t 

At grad«_> the t mmt w«« ••l«ot#d «• an appropriate 

teaaaura of baaic akilla in mathajnatica » On thia taat (Layial , 

Jterm ^ ) ; tha Method A propoaafl atandard ia a acaled acore of 
which ia at the *£le of national performance (grade , Spring). 



1 



At-grade — ^ — - — atudenta-or -percent- of - the-total- number ifere_at- 

or above this standard. ^mong A students in n^athematics , ^percent 

wore above the standard f aa were percent of the B students, 

percent of the C studente and percent of the D students. In 
compariaon with standards proposed by the majority of the other 
MEC districts/ this stnndn^^A fell (within, above, or below) the 
range of cormnonly proposed. In comparison to •the total range of 
standards proposed ,^ this standard fell within, above, or below the 
rang<^. In these comparisons the corresponding national percentile 
scores were used as a rough basis for comparison. These percentiles 
\describe the performance of separate but allegedly similar national, 
nortft groups on ||jj^fferent^^ 8)cills tests. 

In reviewing, the effectiveness of Method fy in this instance, 
it should be noted that percent of the students were mis-- 

classified as masters and percent as non-maaters. ' The proposed 

Method A standard does, however, fall between one ai:rfhdard deviation 
below the mean of the aboj^e standard^ group and one atandard deviation 
above the mean of the below Sr^andard group^ indicating that the more 
typical maatere and non-masters are accuratelV clasaified. 
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Tht M#thod B propoMd ttandar:^ if a gcaltd •cx>rt of , which It 



at the ^%ila of national parformanca (grade , ^prlngK At 

grade , atudente or percent of the totaV number were at or 

above Jjjliie standard . Among A students in mathematics , p ercent 

were abov« the standard as were ^ percent of the B students, 

perceTit 6 f the C~s tudeh t s and p ercent of ^he D studehtsV In 
comparison with 'standards proposed by the majority o^f the other 
tjEC districts, this standard fell S (within, above, or below) the 
jrange of conw>only proposed. In comparison to the total range of 
standards proposed,, this -Istandard fell within » above, below the 
range. In thes^ cc gfcjfc^o nn the corresponding national percentile 
scores were used aS^T iwUg^ basis for comparison. These percentiles 
describe the performance ^ separate but allegedly similar national 



norm groupi^ on different basic 'Skill* tests, 



v'.f. 



In comparing the Method/ standafrc^-to Jl^^Sl^> J*ethod A standard, the 




Method standard al^ws ^^JLJ^*^'**^^^ ^ classified 



Pttrfortunc* Standarda - Gr«<S« 9, Writing)' 

th« 1it«t« r«9ul«tioni r«quir« « siting siunpltt «• thm vmttuMf of 
b«aic ■kill! in ^ritirtg. Th« scoring of writing ••npl«c call for 
a different set of procedures than the scoring of objective, muj- 

tilple choice tests. These procedures cfll for at least two readings 

~ ■ ' ' " " ~ ~ - .- .. - . 

of each paper by readers using the same scale of scores. This 
un^ifortnity in scoring is obtained through* a training axerciW con- , 
ducted 'ininodiately betwre the scoring lession. MEG with assistance, 
from ETS conducted a training and scoring session May 9. During 
this session, papers from all MEC districts usin^ this standard 
setting study service were scored by some thirty five teachers from 
all participating districts. Papers were cpded so that no district 
or school could be identified by any of the scorers. 
u 

At the conclusioh of this scoring session, the teachers from each 
district were asked tQ select a score that represented the minimum 
performance standard - the minimum level of. Acceptable work. The 

. " . teachers selected the score of for the . ■ 

standard. This score was' reviewed and approved by a commtttee of 

eighth and ni'nth grade ■ . teachers, after they reviewed 

the range of papers at' various score point*s. This standard is, in 

r ♦ 

effect, the Mqtthod B standard on this exercise. |ipplying this 

standard to the papers scored on May 9, percent of the ■ 

students were at or above the standard. 
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Th« Method A standard applied to this mtmm group of itudsnts 
thowsd _p«rc«nt »t or abovi tht •tandird . in r«vl«wing th« 
•ff«ctiven^.« of Method A in thi. initanc*. it should b« notad ' 
^^•^ percent of the etudente were mie-cleeeified ae masters . - 

__Jpercont as non-masters. The proposed Method A standard 
-does however,- fall- between-one -standard deviAton^ l^^ 

V f 

of the above standard group and one standard deviation above the 
mean of the below standard group, indicating that the more typical 
maateriB and non-masters are aecurately classi^ie^. 



In comparing the Method B standard to the Method A sUnclard, the 
Method standard allows percent more students to be classified 

at or above standard. 
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, SECTION II 



Ovrview of 1979 Staf R>qulrnHint» on Baiic Skilla In^provm^nt 



This geqtion will present an overview of the new state reguln- 
tionr similar to the overview presented in Section 1 of tljis 
manual ^ . « 



SECTION m 



Rati onale for ^ests Used in the Study 



This section ^wilj review the procedures follcyed and information 
developed in the process of test selection as described in- seol^ 
tion 4 of Alls manual. Td complete this section of the report/ 
the facilitators would need to make available for each teat used 

the following : - 

1) List of basic skill objectives to be covered by the test 

2) Completed Item review foxpr^ ^ 

3) Information on score reports available 

t 

4) Information on t:e6t reliability .and other statistical 
information, when appropriate ^ ^ 
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SECTION IV 



Rationale for Standard-Getting Procadur^a U««d 

V. ■ ' » 

This section Will d«tcrib« th% r^aions for s#l«cting the two 

apprbachea Co standard-setting ueed in thi« project • Justi- 
~ f icittAon will be" presented for the 'tdtlanc* 6n^ p^ " ~" 

judgement at the outset, followed by a review and eonfinnation 
, (or modification) of that judgement by conununity representatives. 

Material for this section will be drawn to some extent from 

Section -6 of this manual. 



SbCTION V 



UettaAlfid Informatlbn Related to Propoaed Standards 



This section will present supportive data for the standards 
proposed in Section I of this report. These da,ta will include 
a set of tables on each test, a nummary of rating scores on all ^ 
objective tests rela'ted to the Method B standard. 

In each subject/skill area t:ested,'V5;ab^e flPwilfL present the 
teaXer. ratings foV all those gr^de rSvels. Table A i^ presented 
heire with fictional data. 



Table A: Teacher Ratings of Students in Math, Grade 3, 5 & 9. 



Grades 





Teacher Ratings 


N 


% 




1 




% 




Abcwo Standard 
• 


200 


40 


240 


48 


/ 340 
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Possibly at Standard 


150 


30 


160 


32 

« 


IQO 


20 




Below Standard 


150 

• 


30 


IQO 


20 


60 




« 

-ERLC 


• 

• 


Total N ' 500 

' ■ ■ . V ■■ 


* 

k 


500 




^ 50ft 
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T«bl«» B «nd C will preient th* acorvs r«lat«d to th* t«ach«r ratingi 
In each aubjact at aacki of tha thraa grada lavali. Tha Mathod B 
atan^ard will alao b« linkad to thiaa two tablaa ao that tha raadar 
can aaa tha iapact of aach atartdard both on tha total group and 
on atudanta groupad by a5:h<j6r^rk8. Thaaa aama thraa tablaa will 
b« praaantad by raca ana aax for aach ikill araa at aach grada lavel 
to provide the adviao^v contnittae with a complata picture of tha 
irr\pact_ the propo8«^j||^ standards . 

Tables B and c are presented here with fictional data. 



Table B: Math Test Scores of Abave and Below Standard Students, Grade 6 



Above 



Below 



Proposed Standard..... 137 



Total 





Standard 




Standard 


Group 




N 






N %_ 






Test Scores 








f 


a 




(Scaled Scores) 














199-90 


20 






• V ■ ■ 


20 


4 


1H9-80 ^ 


' 40 


16 






65 


13 


179-70 




30 






• 

110 


22 


169-60 


50 


20 




• 


110 


22 


* 

109-50 


30 


12 . 






• 55 


11 
















149-40 


' 20 


8 




10 10 

/ 


40 


8 


139- K") 


10 


4 * 




30 30 * 


' 40 


8 * 


129-20 








40 40 


40 


8 


119-10 








■ 10 10 . 


10 


5 


109-00 








10 10 


10 


5 • 


r 


240 




• 


100 ' 


500 












t 

125.2 


160. 5 




S.D 

t 








9.65 


-2i. 3 
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T«bl« C: Math Test Scoroi and Grade* (Previoua Semeater) , Grade 6 

.A : _ .Grade . „A B- C D F 

I: (5) (4) (3) , ...(2) (1) 

N % 

(Scaled Scores) 

if 



.Grade 


A 




B 




n 

- v» - ■ 




u . ... 




(5) 




(4) 




(3) 




(2) 


T6at Scores . 


N % 


v% 




n 








(Scaled Scores) 
















199-190 


15 13 


5 


3 










189-180 


30 28 


25 


16 


10 


6 




• 


179-170 


20 18 


65 


41 


25 


14 






169-160' 

• 


40 37 


40 


25 


30 


17 






) 59- 150 


5 4 


10 


6 


30 


17 














• 








149-140 




10 


6 


20 


12 


10 


25 


i 
















139-130 




5 


3 


25 


14 


10 


25 


129-120 








30 


17 


10 


25 


m-uo 




• 




5 


3 


5 


12 


109-100 








f 




5 


12 



Total N 110 160 175 40 



5 100 



IZOJl 165 142.9 123.7 105. 1 

S.D. 11.6 12.8 24.5 13.3 1.2 



The conunents will be made to each set of tables calling the attention of 
the advisory committee to the salient information presented in each table. 



Appendix B 



(While this li«t d«alt chi«fly with high •chool l«vel fuf, th« 
9«n«r«i batteries include teats of the lower levels as well.) 

^ 

I 

f 

Currintlv Available Tests 

A plumber of tests are currently available for asseesiny basi^ekill 
development at. the high school level. ^^This number includes specialiaed 
test programs, designed to meet a rather 8{>ecific set of needs, and the 
achievement test series which are designed for largt volume use 
in syatemwide testing programs. The general achievemenTTests are li|ted 
in Table 5.1. The following are some specialised tests described briefly 
in alphabetical order. 

• ^LE > the Adult Basic Learning Experiment, developed by the 
Psychological Corporation, tests at a high school level basic vocabulary 
^reading, spelling, and arithmetic used in everyday adult life. The test 
battery, which includes 198 items, takes three and one half hours to 
Administer. 

m • ' 

APL, Adult Performance Level Survey, developed in a University of 
Texas based research project and published by the American Collegf Testing 
Program (ACT), tests at a high school level basic skills in reading, 
writing, computation and problem solving in the areas of consumer economic 
occupational knowledge, community resources , health, . and government and, la' 
This 40 item survey takes approximately one l^our to administer. 



BSWP, th« BAtlc S)cm» Aaa«tMnt Program, davalopad by Educational 
''••ting Sarvloa in conjunction witfea nationwida conaortium of achool 
diatricta, taata, at tliSf^jjiinior high and high achool laval, baaic coropatancia* 
in raading, mathamatica, and writing akilla. Thaaa thraa taata, which 

togather includa 220 itama, tlike approximataly two houri to adminiatar. 

_ program i t un ique in that it providaa an ongoing aacura taat program 

with proceduraa for local «;:andard aatting. 

EDST, ^he EveYyday Skills Ta«t, davalopad by><:TB/McGraw Hill, assesaes 
ttudent mastery of reading and math skills at the intermediate level 
(grades 6-12) using i^ems with a practical orientation (job applications, 
discoi^t rates, etc.). These test* require approximataly 2-1/2 hours to 
administpr. 

GED, the General Education Diploma Tmit, published by the American 
Council on Education, is the commonly used high school equivalency test 
for adults. These tests cover English expression, Reading in Social 
studies, Science, ^nd Literature, ind general Math. Spanish and French 
language versions- are available. The useTof these materials high 

^schools would require special neg^^ations. 

lOX Basic Skills Tests, de^^Bed by the Instructional Objectives 

^•Exchanqe, tests skills in reading, writing, and mathematics using* "real " 
life'' contont. Two 45-minuto forms are available for each of the three 

tests. 

SHARP, tht» Senior High School Assessment of Reading Performance, 
developed by CTB/McGraw Hill in cooperation with the Los Angeles Unified 
School District, tests minimum competencies in reading akilla deemed 
necessary Cor everyday life. SHARP consists of thirty displays of 'everyday 
reading materials, niatched to behavioral objectives. A parallel computational 
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•killa t««t (TOPICS) it sohttdultd for publication in Ptbruary, 1979. 

A Writin9 Skilal T««t *nd Writing SMigpl* will b« •ytil«bl« in th« Pall of - 

1978. 

SRA Survival Skilla Tmntn . publiahad by tha Scianca Raaaarch Aaaociataa, ' 
taat raading and mathamatic akilla on avaryday, practical itama (aalaa 

«lip«> racipaa, road aigna> caution labala) in a achool adition (gradaa 6-12) 

and an adult adition (gradaa 11, 12, and abova) . Thia 120 itam battery 
requiraa approximataly 2 houra to cowplata. 

TABE, tha Tast of Adult Basic Education, publiahad by CTB/McGraw Hill, 
taata baaic reading, niathematica and language akill* at the junior high 
achool level. Thia newly published shorted version of the California 
Achievement Test listed below includes 328 items and raqu^rea 3 houra to 
administer. 

Services for Local Test Development 

In addition to published materials, several test publishers provide 
services that enable districts 'to have tests developed to match objectives 
which the districts select from a bank of objectives developed by tha|) 
publisher. The SCORE service, for example of fared by Hpughton-Mif f lin, 
enables a distrfct to choose from a bank of 1700 objectiv^a (K to Grade 9) 
in reading, language arts, and martljematics. Teat copies are prices for 
orders of 1,000 or more on the basis of the number of pagea in the test 
(e.g., 1000 copies of an 8 page test would cost .98<! a copvX^ CTB/McGraw 
Hill offera a aimilar service called ORBIT with over. (K to Gradp JL2) 

objectives in reading, communication skills, and matllamatics. The / 
Instructional Objectives fcxchanga offers a similar iia\ of 'aarvice/; SRA's 
mastery program would provide cuatomitad teat services l^S.#h*'Maa of 
basic skills ^ssasimant. 
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tabit 5.1 

California 

Xchlav«nant 

Tmmt 

Conpr#h«nslv« 
• Tttt of 
Baalc Skills 



lova T«tts of 
Basic Skills 



lows T«sts of 

Educational 

Davalopnsnt 



Saquantisl 
Tasts of 

Educational 
Prograss 



Stanford Tast 
of Acadanicr 
Skills 

Tssts of 

Acadsmic 
Prograas 
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LEVEL 



4-5 



3-4 



2 6 3 



I 6 ir 



Form S 



GRADE 
6-12 

6-12 



9-14 



'9-12 



7-12 



8-13 



9-12 



CQWTEWT 
RMdlng 
Languid 

Language 
Math 

Rafaranca Skills 
Scianca 

Social Scianca 



Vocabulary 

Raading Comprahansion 
Languaga Skills 
Work Study Skills 
Math Skills 

TOTAL 

Rasding 
Languaga Arts 
Mathamatics 
Soaial Studlas 
Scianca 

Usa of^ Sourcas 

Raading 

writing 

Bnglish Exprassion 
Math Computation 
Math Basic Concapts 
Scianca 

Social Studlas 

Raading 
English 
Math 

Social Studlas 
Composition 
Scisnca 
Raading , 
Math 

Litaratura 



PUBLISHER 
CTR/McGraw Hill 

CTB/McGrav Hill 



Houghton-Mifflin 



Scianca Raaaarch Aaaociataa 



I 

4^ 

I 



ETS/Addison-Waslay 



Psychological Corp./HBJ 



Houghton-Mifflin 
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Appendix C 



Basic Skills itm Rsvisw forw 



Grade 



ItM 



Content Taught 



Earlier 



Thle Yean Later 



Skill l^evfl 



Basic 



Advanced 



Related to 

Local Objective 
(cite «) 



Comment 



' HOLISTIC SCORING 



What im hollatlc tcqrlng? 

A. Th« th«ory. O / 

1. The whole of a pltc* of vrlt^ng li |r««ter than any 
of Itf parts. 

2. Engllah tcachera, t\hough bhey may h«v« difficulty , 
in giving a verbal daacrlptlon of writing abllltfy 

\ thaV 1« recognlrabla to all, can racogplxa good 
— wr 4 1 i ng .whan thay a'aa 1 1 . — ~ — 

3. Though In an analytic raadlng taachara may not agree 
on the weight to be given a pirtlcylar trait, these 
aatM teachers will. In Judging a work as a whoUi ^ ^ 
rank papers In much the sasii'way. ; ' 

No aspect of writing iklll can really be judged 
independently; the halo effect it always string, 

B* . The method, ... ► 

, 1* The standards. / 

; ■ ■ ' ^ ' ' ■* " 

a. Standards are not imposed upon readers; readers >t . 
:^hem8elye8 determine standards. 

b. Papers are not judged against an ideal, but against 
what is: ;what students have written^ on t;hia topic 
at this time. , 

c. Standards musV be maintained and relriltorced through- 
out the reading. ' | - 

2. The judgment's. ♦ / 

V Jvidgments are o^ade on anonytbous pai$ers. 

b. Judgtoents are independent. . ^ . 

c. Multiple judgments oh each paper'are mandatory. 

-d. Judgments oust be quick and imaedlate. 

e. 'Judgments must be definite, fo^ the score scale 
has no middle points. ^ • 

3. The scoting. 

ay " The score l/i the sum of aU the . readers' judgiajenttv 

b; Sonedijcrtpanties In the score* the reaaers give 
art! t'o/he expected. 1 * 



Sir' ^ ' ■ ^■■-2.' ''". W' • 

• Wl (It) Uljicrepanc it'H hotwocn rtin^Jc'r«>4BcnfcS 

»"»M»t be coi rccic< Imuwdiatciy,* -« , - 

^r Kiocular ddverficii<ic from tho stnndnftJt on the part 

fi ' ; of «ny roo«Ior must be corrected." ■r'^it* 

. ' ^:.C^:^ /. 

,11. WJiy tj«o holii^rtc scorjlng? V^J^lPv 
:■• ..-r- . qfftfcclnt.. . • ■ f . . , . 

* iJ. It Is rell^blQ. ■* ■ '^.i^ 

• t '\ ♦ . .• ■ ■. ' .v*^ ^ 

■ / ' .It emphaaiTics what is right rather than what is wrorffc • ' 

/- K - ■ with a plec^^^ : " ^ 

. D. It requite.s' consensus among rcader^i. " 

B. It encourages evaluation of th« program, as well as the 
individual pieces of ^riting. 

III. How is a topic scored? (Actuaf rea< * 



A. The topic is read and analyzed. ' ♦ 

B. The ground rules are established. • . ' 

C. The ctandardH are set thr^^gh the use of sample papers. # 
^ p. The Jjapers are read. t» 

1. first reader's score irtust remain unknown to other readers 

2. /All papers should be rea^ once before any are read tv^ice. 

3. Readers mu^t be allowed to rest regularly. " , ^ 
A. Pap;ftrs must flow efficiently fronv reader to rcider. ' 

*rv. What makes a good topic? ' ' ' . ' 

• A. The .interest to th^ atudbnjtiS. * . * 

^y/b. The interest to Che readers. 

C. V The range of writing, it produces. , . ♦ | 

D. The' relative objectivity with, which it. x:an "be.: stored. ' 
. , ' -. ^ ■■ ' ' ■ - a ■ v - ■ 

Vi Of^ what use , Is holistic sc9rin8 tq . the, schools? " ' ^ 
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' Ay i-^t can promote communication aboiift' the 'teiSchinft of wrltini' 
among faculty niembers. " • 

; B. It can bo. used et> measure growth -in stutJcnts' writing ability , 

C* ennblks tcachcra to '4fiotG writing asslcnitints qulekay and 
• , rclinbly. > ' , - ^ ' 

EMC i. D* It calls for mthltlplo cv^iluntloSt?' ^§3 * ^ /' 



•TOPIC 



HOLISTIC ESSAY SCORING WORKSHOP 



If we listen to its critics, television is to blaine) 
'for half the tilings wrong with our lives — every- 
thing from our poor reading hhbits to the high * . 
crime rate. Very few people defend television, and 

yet it must serve some worthwhile purpose. 
.» 

/ \ 

What values do you see in television — to ai^ , individual , 

to a f aOtvil^, to society? Discuss one or twol^di^ these 

values, tailing what -each value is and how it: benefits 

people. Use specific examples to support your ideas. 

\ ■ ■■ ■ 

- Twenty Minutdfs - 



4 '■ \ 

TO,B£ ASSIGNED TO APPROXIMATELY FIFTY .STUDENTS IN A CLASSROOM SITUATION 



? i|i> t.: C AT i o N A 1^ I' I : I I N ( I S ) ; 1 1 \ I ( ' 1 0 
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Appendix P 



M IDNVIOHTKUN moC.IONAI. OlM 



IK^ Crc. c Strccf 



Memorandum for: Holistic Essay Scoring 

Workshop Psttlcipants 



y 



Subject:- SCbPlng Codes for the 
_ %TOrk*hop essays 



Enclosed please find the es.sayyil submitted from your class(es) for 
thV) workshop instruction. 



^ V As' you will recaljl , .each workshop participant indicated his or her 
•core for an essay by fusing a letter code. That Is, instead of recording 
the score 4, 3, 2, or 1 :on the essay paper, each reader indicated the ^ 
appropriate score by ap /assigned letter.. Each reader had a unique code; 
however, in all codes* assigned, a particular letter always represented 
the same value. For exanjple, .whenever B was assigned. It' represented the 
value of 4; whenever G wa^s assignee}, it represented the value of 1. .The 
basic code follows, indicating the letter • equj^viilents for the four scores: 



(high) 




B 


E 


F 


K 


P 


R 




3. 


I 


J 


< 

L 


S 


.T 


Z 




^' 1 


M 


N 


V 




X 


Y 


(low) 


1- 1 


A 


C 


G 


H 


0 


Q 



Each paper was read at least once. About halft the papers were read 
at; least twice by *two different readers.; Of those papery^sciored twice, 
many were" checked for discrepancies. The scores given by both readers 
were accepted if: 1) the' same value was- assigned by both ceaders to the 
essay (i.e. A--A^ 3-3, 2-2, 1-1) or, 2) the two values afsSlgned bf the 
readers. were vithln onc^ point of e{ich other (l*e., A-3, 3-2, 2-1). On 

.the other haind, papers wi hh a vdls'crepancy of more ^han one point between 
readers (i.e. A-2, A-1; 3-1) niecess^tated a third riding. Note again 
though, that not all the papers w^re rea^J twice and.^f tho^e papers read 
twice, not all were checkied for discrepancies. Therefore, itl papers 
truly necessitating a third reading were not read a thivrd'^tlme due to ' ^ 

,time constraints. ^ • 

By noting the above code, you will bo able to determlnfe the values . 
assigned to each essay written in your clasa^C^es). Bfear^ lYi min^kthe 
i^:andards, w^re ^set by reading papers from all gYade levels and^rrotn dif-- 
ferertt schools/ J^iilc 



J^iile decoding the scores will facilitate feedback to 
y#ur students, caution should be taken In interpreting these scores. 

Again, It was a. plea$uro working li^ith you 
upon us if we can be of assistance in apy 



Please feel free to call 



/ ' ' Mrtp«ndlx G 

HEC 1 MlPRbV I NG BASIC SKILLS PROJECT .i" 



TEACHER RATING FORM 



Directions foi^Teachors 



The new Massachusetts Basic Skills Improvement Policy 
"requires local school districts to establish minimum performance 
standards" in basic 8kiH>« in order that; additional attention may \ 
be given to students who are below/this minimum standard. 

Using your class list, you are asked to rate each student • 
whom you are now teaching' reading or 'writing or maihematics. » 
Basic skills do not n^pessarlly describe the ful^l range of skills 
taught at any one grade level. A sample listing of basic skills 
>t tjj^th grade level is attached. In V«ach***kill area you now 

t^^h, please rate each student in .reference to basic skill 

■ . — ^ ' ■ • 

mastery at his or hej|. part icular grade level , using hhe of the 
following ratings: if' 

"1"' This student iA below minimum standards and definitely 
needs remedial help 



II ti 



This student is close to minimum standards and'^'may or 
may not need remedial help 



\ 



3" This student is above minimum standards and definitely 
does not need remedial help * \ 

THESE RATINGS WILL BE COMPL^ELY CONFIDENTIAL. .THEY WILL BS' ' ' 
USED ONLY FOR GROUP DATA ANALYSIS AND**WILL NOT AFFECT THE STUD^Nf " ^. ^ . 
IN ANY WAY... • * . ■ • ■' ■ ■ / ' 



r 



ERIC 
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Appendix G 



cuss LIST 



SCHOOL 



GRADE LEVEL 



1 



, PLEASE READ DIRECTIONS BEFORE BEgInNINGv^ PLEASE ASS TgN TO 
STUDENTS YOU >iQW TEACH Ibl ONE OK MORE BASIC SKILLS, ONE OF 
THE FOLLOWING RATINGS: ^ ^ 

This, student is below minimum standards , and definitely 
needs remedial help. 



2' 



This student is close to minimum standards and may or , 
ma^ not need remedial help. 

"3 This student is above minimum standards and definitely, 
\> .does not need remedial h^lp. 



• ' ' ' \ ^ . . 

. ■ ' NAME 

»^ ■ . _ . 


— ■ ., \ _ 

BASIC S^ILL 


, JREADING LANGUAGE ARTS 
V ' , CWRITING) 


MATH 






-I — ■ _ 




- V ■ 

t 

* 

'^'^^^^^"^^^^'^^ . i i- 






if 




■ - V — 


















< * 




•; ■ V ■ * ■ ' ■ . ■ ■ 


\ ■ 


1 




. J: . . ■ . ■ 

ft ( , ^ 

J. ^'i^ u L 1 , _ - ^ 






— ^ — 1 


' p - ♦ > • 
* \ > , f - - i . 






Ju^. i. . 


::^ERic ■ ■ . . • : - 






1 1 ■ I . ,, , , ,k 
> 


•■■4 * . ' . 
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Appendix. H 



P«rt A 



Part B 



School District 

.1 

Gradt L«v«l 



Mo. 



Yr. 



Pirit 



Spec, 



Nin Lan9 
Stat Stat 



Oradts*** 



Taat loorf 



l<an9 






— — - 


1 

I 

.- I. 


















u lurti 






lAr^ 








r 


















- 














1 
1 
























— — ^ 


: 






1 

' 1 


























H ^ 






1 

. -J 


















■ 








/ 






1 
1 






























> « 


1. 

'.. . . 1... 






> 






















> i ■ » r — 




1 




* 




























I 
1 








« 
























1 

• 
















— 














( 


1 
















1 












> 




, 1 






■ ■ 


























■ ' 1 
_ ,1 










. .V. . 




i_ 


I' 
















I'* 

1 
































1 
1 










> 






















1 












■- 

















Lang 



If minori^iy statvjs - enter 1 ♦ 
lf( igm-minority status - enter 0 

If non-Engaiah spe&kipg' - ervtefr 1 



A r 4 

B « 3 

C - 2 

P - 1 
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student performance considered ^ 
below ^ itandi^^d — enter 1 * 

Student perl^onnancf conaidered ' ^- 

about standard en-tpr 2 ^ 

. ^student parforinance -oonaiderad • ■ 
• .abova *t>andard anter ^ 

J ■ ■ ■ ■ '■4^ '■■^ . ■ 

^ to coinply yith.cqhfidantiallty prpcAdu^es "» 
datjkch and forward only Part -B to.kEC/ETS.' 




-2- Appendix H 

D«t« Intry fh^^t - mc Improving Basic SkJLlli Project i Dirtotloni 



P^yt A cA^s for student fx^mmm tor any ont qrada l«v«l to b# liitid in whatiyiV-^ 
or4«r is cx>nv«ltnt for local purpoiw,. Tjo poa^ply with confidantimlity pro-^ . / 
c«dur«8r »ft«r tha antira form (Parts A 6 B) ia oofplatad, Part A la to iA^ 
datachad f ro« IRart B |>y cutting along tha dottad lina. Only Part B i» to ba 
forwardad outaida of t)^ school diatrict. 



^^^t B calls, for aovaral piacas of informatipn on aach #tudant, aach of which r 
is dascribad hare. 



^ Spac. Group '' - identifiiJa tha atudant as balongi^ng to qna of tha following 

groups: 

Title I students (not on qAI) - aatar 

Title I students (on CAI) - enter "2''. 

Special education atudanta declared eligible for 

basic skill testing -enter "3" 
(Those special education students who were not explicitly 
declared aliofible for^ basic skill testing should NOT be 
named on the Jjlist) t 1 
"Sex" - identifies the student asc female - enter F^gfll^r male - enter M 

" Min Stat " identifit^i the student's minority group status as 

I belonging to a minority group - enter 1 ^ ' > 
not belonging to a minority group • enter ^0 . % 

." Lang Stat " identifies the language status of the stq^eif^ as * 
from a home in which English is NOT spoken* - e^ter 1 

or ' 

from a home in which English is spoken - enter, 0 » 

'^ Grad^ '* call for the most recently available semalter grades in reading, 
langJPe arts or writing, and mathematics, which should not include Algebra. 
Grades, shouljd be entered as numbers according to the following scale: 

A «^JL^ D « 1 Pluses or minuses shoxild be overlooked 

B'^a F m p for purpbses of this project. 

^ C - 2 

" Test scores " call for publishers V scaled scores from all basic' skill 
objective tests and total scores on essays* refers to total 



r 





acores,"^Liing Arts'" rafers ta^Jdhie "J^nguaga Arts** score on the staridifrdiced 
teats and the total score onM:he writing exerclaa^ ,>./!Math" refers*^© 
; ' total math scores. . . " \ • 

. ^ " Teacher Ratings " are to be transcribed ^rom the class Tists completed by 
the teachers, on which each student is.rited as: * 
^ ' ' ' "1" below standard 

"2" At oto. closi^ to standard \ • . 

' * . "3" ^Mve stdtndi^ ^ V 

v. If two or m6re teaqhers happen to submit the same ratir^g on a student in 
a given skill arta, use the rating. If the/ submit difl*terent ratings,, 
. enter a ''2"/ . . ^ i ^ * ' 

<^ Thet^qfaittpletnd i^prms should be returned to your local *di»t|r^ct facilitator 
^ for the pr(>jAc?t; ^ - ' * ^ t . 
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CoiniTK>nwe*lth rjtf Massachusetts 



Departmefnt of Education 
Januaty- 23, 1975 - 

; ■ . V 
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MASSACHUSETTS BOARO OF EDUCATION 

Chnrlos \t Gf lgsby, Chal rpcrsor> 
Annf> H. Mft^iuyh, V i cc-Charl rperson 



James Azj^ifrt to 

John W, Bond / 
James L. Green 
Howard A. Ore i s 
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Joseph C . Me 1 lo, Jr . 
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tdwin M» Rossnwin 



Grc^c^^ty 4R. Anrii|» Con^n i ss Ioikt of Education, Secretary 



i 



Ex Officio Member:- 



E(^rd.C. McQuh'^^ Choncell.or, Board of Hrgher €ifc.icatlon 



ERIC 



The Massachusetts Department of Education l-nsi^ies equal employment/ 
educational opportunities/and affirmative actTon, rdtiardless of 
face, color?' cr^eed, national origin, or "sex, In' compl lance wl th 
T'tlc IX, or handi-cap. In compliance with Section SO'*. — ^- . 

•Publication #1 1 182 approved by Al f red. C. Holland, State PuVchasIng Agent. 
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Regulations "-govern I ng the .Implementation of the Basic Skills Improvement 
Policy were ocloptcd by the Massachusetts Board, of Education on 
January 23, 1979. . V ; 



\ 



I. 



Introduct Ion 

The purpose of these reguUt lons>j8 to Implement -the "Policy on Basic 
SklJU llhppovemfnt" adop-ted by the Board of Education on August 29, 1 978 
«nd to assist students In achieving mastery of bas<c cklHs prior to hfgh 
school graduation through the provision of approprlntc currlcMjm, Instruc- 
tion , and rva 1 uat Ion . Those regulat ions shall A^pply' to al 1 public school 
disttlrtfi providing educational services to stMdcnls In a Tl or part of 
qrados kinderyar t<^n througii tu-Hve In the Commonwealth of Massachusetts. 
These, rogulat Ions ore prom.i 1 cja Led by the Doard of Iducation purr.uant to 
lt«u powers under S«-ction IG of Chapter 1 .S of the General laws whic1» directs 

-tha t__''Lhc._board- slia-l-l- ei> lah)-i-?,h-mi tvl nium- educ-at-lonij 1 ~5:t c)ndflrd5 -for*' a 1 1 

courses which (>*blic sctiools require their studentr. lo take" and which 
<jtil!i :..r i /or. the board tOj"c()llcci and ma i ti I ci I n Iriformnt Ion f rom any^pubj i c 
5chc<)l system in the Conwnonwoa 1 1 h . re 1 evapt to its work..;." In Implementing 
these rocuilat ions , public scfiool distrlc*ts shall place empt\asls on diagnosing 
U'orniiKj needs and adjusting the regular curricuHum to meet these needs. 

^lO.Ol: Oefi n i t i on s 

;he various tenir:, as used in those regulations are defl hed below: 

/)lL^lr^':>Ly J:I'/-lL"JiAil^^^^ the Advisory Committee oii Basic Skills 

liiiprovcMiKMU eslabl i shed t^y the Roard of Education pursuant to Section l\Q^.]] 
of tlu^se i,eM)u 1 .1 1 i ons . 

ff 

.^!L'>.l^\'„-!?ilP2„L^^^ sfKill mean the Annual 1 Report on Basic Skills Impr'ovemont 
Program'^ v/fii^ji public school distr-icl.', shall submit to tlie Oeportmont of 
[■duc;alion purse, 'nt. to Section '1O.O9 of- tficse regulations. 

Bfsic ski 1 I r> shoM m cnn {he. fol lowlpq skills: reading, writing, 
listmifuj, sp(;ak!r)q and nin thc^nal i cs . 

.^~1?-L^..~.^ sliall moan the programs which public 

school cli^\rict.fe ore re(|uiic(i to eslabMsh by Section ^^0.02 of these ^ 
rocju Ki t: i ons . V ■ 

* ,!"jrlVL. elementary level shall mean all or part of grades kindergarten 
througt) three. • 

^ ■• ■ 

( ^ ) ■ .^::irJLX_iLU:!ll^l':^Ul'Ly n [i}rxJicve l program plans s ha 11 mea n t he 
. written documents pubfic school (iTsFrTcts shall prepare pursuant to Section 
^♦0.06 of those regulations. 4 ■ 

" i ■ • ■ 

(7) Evaluat ion it)st rumen ts shall mean the tests or assessment techniques ^ 
that public school d i s t r i c t s. sha 1 1 use to determine whetlier students have 
or fiave not achieved mi-nimum standards. ~ 

iil^j£I_^Llil''l£L']ii(X.L^^^ shall mean all or part of, grades four through six, 

(9) Minimum standards st^gll'mean (a) the objectives In the basic skills and 
(b)' the level of achTevcment. for ^e object I ves In the basic skills that public, 
schqol districts shall establish fbr students for the early elementary, later 
elementary, and secondary levels pursuant to these regulations. 
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(10) Parent shall mean a father, mother, or lega) guardian. 

f u b n c sc hop t district fh<t1 1 mean city, town and regional school " 
committees; local and <tl stVlctNriystees for vocat lonal , educat Ion and 
boards of trustees of county ogrlcultural schools created pufsuont to ,t 
General L^ws, Chapter 7A; Superintendents of Smith's Agricultural School 
cstobllshod by Ch.-)ptor 151 of .nc Special Acts of l^iS; and the governing 
boord of ,iny othor public r.chool providing oduc-.nt lonn 1 services to rtudcnls 
In i^W o\ part of qr.nie<-. kirKle-rqarteii through tv/cslvc In the CoiiKiK^inwc.-) 1 th 
of Miissc»chLii;ot.V'ji. The public 'uliool district Is responsible for the overoll 

_ Implement «i ion of ~ t l.cf.e~r nqulnt i onn— but-l t nk^y "dcregaTc "t6^rts"p"ubTl c 

School <-u1nii n i --.t ral icMi tfio specific tosl^s rc(jui red, by tti- rcgu 1 nt.l ons , as 
iippr opr i t: . ' . •■ . 

^'^^ ^2Ji^J?ilIlli'ii?.'^^ii^IlJi^^ "lean th^ s I x opera t i ona 1 f i ei d 

offlc<^s of the Depai tmcdt or' Educat ion loootpd In specified geographical . 
rcglotis of ttie Coii>,i!otiv/on 1 th . 

^'^^ ii^:ilL°LlC'l_L'l^l^''lli^lJ^.'^^^^^ ^^^-^^ the counc i 1 s establl ^hed by the 

Board of (ducat ion pursuant t-^ the "Revised (Voard of Edi5ca t i on Pol i cy on 
Regional [ducat ion Councils.''- j * 

(lA) Sc^coruWy J«^v6] shall lueaii all of part of grades seven through twelve. 

^^^^ ^~--.'?iXJ.>'^^^^^^ niean tlie wi^itten documents public 

school di vLi lets shall ptoparc pursuant to Sec t i on J»0.. 0? of these regulations 

iipJ51':j_„.J^^L'^J,^_,^iL' LIJ!!: Program 

0) Each public school district shall cs tabl I sh # bd%i c skills 
iniprovoinen;. pfo,)t\ii;i which shall include tfie estnbl i shm-^nt of 
minii,ui;n standatds and prov.isic^D for eva 1 ua t i ng' s t uden t aciiicvcment 
of.;;n)i<fiiiuini :;ia(ulurt!s required by Sec t i ons ^ ^0 .'03 to'jO.OS of the'se 
regulations, and the establishment and< imp 1 enien tat. i on of the early 
clem-.-ntary, later elenicntaty and secondary level prograryf plans 
required by Sections' .^)0.06 and hO.67 of these regH 1 at i ons . - 

(?.) l-^ch public school district shall provide for genuine public 
participation in tlie development and periodic review of Its basic 
skills improyom.int program. At all grade levels, public participation 
^ha.l 1 iiK;1u(!a: employers; 'parentSjt-^ including Ti'tle I parents^ of 
st^prits enrol led in the public school district; teachers -aqd 
adrnini strators .employed by the public sci->ool district; and the gene. 
public. In addition, at the secondary level, publ ic part ici pat ion shij 1 
include secondary school students er^^ol led in the 'public school 'dis t r i c t . 

A0.03j^ Esta blishment of Minimum Standards 

(1) Each public school d i s t r i c t shal 1 establ I sh min Imum standards - 
In each of the basic skills for the following grade lev<^ls, If 
applicable: early elementary, later elementary and secondary. <• 
At the secondary level the minimum standard^ establ I shed by each 
public scliool district siiall include, but not#nccessar 1 1 y be , 
limited to, the basic skilly object'ives SJ%t forth In Section iiO. 0^ 
of these' regulations. , . * 

■ Q • («) By August I, I98O, each public school district sliall t 

ERJC establish minimum standards In the basic skills of reading. 

• writing and mathematics. ^3- , , 




(b) August 1, -ISSll each public school ;|I 5trJ ct shall 

estubilsh mlnlmum'^standards In the baslc-skfl Is of - 

listening and sp.eaklng. , 

(2) Each public scliool district shall deter|iipe thoXspcc I f 1 1 
grade or qrodes within tlie early elementary, Vator eljeniento'ry 
ond secondory levels for which mlnlpumi Standords shMl be. 
established. 

^O.O^t. S ccondnj-y loyal Mii il nuir;i._Sl^n d.iir^^^^^^ 

The f.cconfkiry Icvnl mininaini stnndords sholl include, but not 'fiocesscii 1 1y • 
be limited to, the followincj basic skills objectives: 

(1) Re*dinj[. v • 

Basic Word Mcaivinq 

), Identify tln^ mfumlnci of con^inonly U5ied wori^^s within o 
sentcncf^ that does not provide clues to . the me^jn Ing 
of the word ^ 

2, Identify the meaninc) of a .word within a^'sentence that 
providr-.; rlui^r> to the meaning of the word . 

(b) Literal toinpretiens i on ^ 

1. Identify tfie mea;nng of a written phrase, clause, sentence, 
or p^H'agraph 

2- *. Demonstrate the abifity to follow directions 

3. Id«l|?tify the luait^ idea, supporting detf^Ms, and conclusion 
of a parcKjra[)h . - 

h. Rccocjni/e the sociuence of events or Ideas In a written 

passage . " ♦ . 

S. Identify Information on a chart, map, or graph ^ 

(c) I n t(;rpret i Comprehension ^ 

1. OrnwK.oiic lus ioris Implied in a paragraph or fwssage 

2. Identify Cciuse and effect re 1 a t i ®ns[>f ps implied In a 
. ■■ parpcjroph or passage 

3- '. Predict an outconie Implied in a paragraph or passage 

(d) Evaluative Comprehension ' ^ ^ "-^ 

1. Identify a statement as fact or opinion * 

- 2. Identify the writer's purpose in a paraoraph'or passage 
wr i I ten to . i nf orm or persuade^ 1 

(e) Locating Information , 'J: 

1 . [\se the parts of a book ♦ 

2. L6catc information in a variety of sources , ~ 

(2) Wrljt^hi^g^ Given the opportunity to use a dl'bt lonary ,.^^tudents , ♦ 
TITrougli tlieir own wr i t i ng «fTip 1 es', will demonstrate: 

(a) Knowledge of the subj^lret 

1. The writer has something to say 

2. jdeas are suported with relevant details ^ 

(b) Clbar and consistent purpose 

(c) Organization^ ^ ... 

1 . I deas are related 

2. Ideas progress logically from one potrvt to another 
. . (d) An awareness of the InterKleci reade^r 



er|c . 94 



(e) Precise word choices * • 
K Words ^pp.e«l .to the .reader's senses ^ 

2. Words su IV the purppVe' ^ : ^ . ; • 

3. Words are op[;)ropr late for thi Inton^l^d re^^dcr 

(f) fulflDment of the purpose 

1. AdCMju<)tc Informal ion Is provided ^ ' 

2. The writ iru, Is free of Irrelev^^ncY • 
3- TfKV cone 1 111. i C'H ro.Ofyyha v ! 7or> the [n'M p(>oe 

(y) CorriH:t copi tal i / ion and puDCtimt l-on 
(h) (^or rec t spol 1 I urj 
- (-1-)— trcgrbi c-hnnilvv^' tt tnq" ' 

(k) Stc-^ndni'd use of nouns, pfonou'ns verbs , cjdjoci I vcs , ond 

aaverb'i \ ^i*-,^, ♦ _ 

(1) Aqreemvnt of subfect ;nV^ veVb ' 

• • • V 

(a J t.r^'ic Li.titeniiHj Ski Ms V ^ ' ' - 

1. Rtvcocjni/^ words andlphrcii^es used by the speaker ' 
. 2. huiic^te why the sp^<W<er con or cannot br, understood 
■ (b) ll:)i,lcMv.;lri(Kling Whnt You floor ■ - ' 

1. ^ Understand spokorA word'"> ond ideos 

2, I dent: i f/ oful understcind main ideas 

3' Ass()c late imfwi^c deta M s wi tl) ma i n Ideas ' 
A. Ufid^^rstand ffffser ijh I ons of events and experiences 
5 .^ ''ndcf's ( ond yipe-^kor 's ptjrposp 
(c) . Us.iiK] ,Wh;:jt: You flear . . ^ ' . 

Ufiderslnnd amrrei^pond- to 5ur\^1 val words used In;;? 
■ ^^ CMDcrgcMicy S;i t"ua t i ons:'' ' . . • ^ 

\2. Sunimriqi/c information ond drqw cone his I.oivs 
■ X pecociDi /.c, when wor(^^ aful phrases are used to convince ' 

* ^ ■ C)r pe r sua do » * . ' . ' 

h^low sfrdic^Ktfopwnrd di rect ions ' ^ 

(n) \^:^~,\c Qr,H Coninuin i ca t il^n Skills . . 

1. Usr'..vyor(l^ alKl pfirqsos . nppropr i a tr: tcV the slti..-itfon " 

2. .SpooR IoikII y' enough, .to be heard by listener or " ' 
• (iroup of HstecKjrs , ■ . " 

3. Speak <it « r<-)te the listener can understand, 

h. Soy word'* tti'/tihctly ■ • . v * ' . § ' 

(b) . Plonniru),, Deve loping and ,S tat i rig Spoken Mes'sages 

I. Uso \-K>viH iji..^ri order ^that cle'^rly expresses thti thought 

• Organize iiiain ideas for pre?entat i on ■ ' 

"3. Statje. maitr ideas elearly 

. h. S'uppbrt ma-in.i deas wi th Important details"^ , ' : •■ 

5.; Demorlstratq/knowjedge of staVidard- EnglisK usage 

(c) Common Uses of Spnkcn M6ssanes '►^ ■ " , • ^ , 
1-. Use suryivial words to cppb-'wtth emergency si tuat,|,dTls". . 

Speak so llstenpr understands purpose •/ 
Ask for dn<i give st ra*! ghtlorward i nforrtia t Ion / \' 
bescri be objects , events and experiences ' ' ; 

Questiph others', viewpoints , 




(5)l:t Mathematics "r'" / /r;-^;;. 

•■#(a) dumber aMj-Nii,neri»tton Concepts '^S ' r'^' -'■■V 

1. Rec^gnlz^ number symbol s {1 7, elghtaen), whole numbers (3^i)V 
fractions (f)r;i_eclmals (3.75). and powers o^iiO 
■ 2. i<|ent i fy odd ond -even. nlMiibers ^'-^ ' 

* 3. Put numbers In fu)mcr/(cal order 
, , ^ • M. Recognize e(.'iivn lent, fractions 



(b) 



(c) 



(d) 
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Ar I ttiii!'; t i c Coinpiitnl ion • - , 

*1. Add, ivubtrflcf, iiuiltiply, and divide whole numbers {l\OCd + 8l 

' +123, .2r.t< X 17, 16,300 -100) 
^r . A'^jd, i)tVd_ si^tLOjr.i/rfi|.)^l rt.unibe.r.S^ 



3. 

V. 
1). 
6. 



Multi.ply whole numbers or n>oney by fractions (halves, quarters 
thi rds) - ' ' ^ > 

Add 



recipes, scale drawings) 



subtrnct, inulMp%i and divide decimal numbers like money 
C.f)ri!Kjc a fr.icLion to a dec i ma 1 . (j1-. to .25)' :' 
F ind a percent of a' number 1 n. s i tuat i ons^ such as simple 
• lntero5>t, discounts, commissions, and taxes ~ U • . 

7. Use ratio -nd proportion (mixtures 

8. Usesiniplo; formulas (A = x v^) 

Est imaf: ion an(! A[)prox i ma t i on !- ■ 

1. Roundoff numbers to a, specif led plJice !': 

Approximate the answer to a computation probl em' '(^i ncl^jd i ng 
discount's and percentage's) 
fs t i ma te 1 cfuj tli", we i cjht/m'ntis capaci ty , 



2. 

3. 
^1. 



aroii 



and vol 
w' 



tl^, te/mpetfiture , 

% ■■ '..-'■] 
■stimate w'.th money " , vlf- ■ , l-j 

M|^asurement an,' Geometry i ' ■ ' 

1. Choo';e an Appropriate unit of measurem(<nt in rhe:|u..S. 
customary systc>m (for cxamp 1 e , f ee t , 4>ouKds anc^ gallons) 

2. Clioc)';.(^ ah appropriate uni.t of measurement I'n the'j iWt r I c 
system' -(for example, meters^ kilogi^jms, and lite'|-s) - ■ v 
Choose rin appropriate measureinent liSstuument Involving 
botii U.S. cuv-tomary *and. metr i c units - ' I 
Convert common niec*<suremen ts wi th i n t,'h"e -?ame .sys tt^lii 
Read a scale dtuwing . 
Use. a map to compute highway distanH^es 
Rela'to total cost and cost por u«*4^ - 
Coni;)ute by using temperature ' ' ; 
Compu te by^ys i n'g -t fme , * . ^ 

lOv >ldenti fy right angles and parallel, pei^pend i cu 1 ar , tind 
rintersecting lines like those I n" a street m^ip 
Recognize that an objeot. has the shape bf a square, 
rectangle, t r i nng I e , p'A para 1 1 e logram 
Identi^fy the racMus, •diUeter, and center of a circle" 
Recoghi;?e that an object",has the shape of a cuboi, cylinder, 
or sph(Jre . ' 

Find tlie perimeter of a t r I angl e , square ...and >ectang 1 e 
Find the area of a triangle, square,*and rfectahgie ' 
Find the volume of a cube or other rectangular sol 1 cf 



3. 

6. 

8.' 
9. 



n. 

12. 

13. 

15. 
16. 



^ (e), Graphsiand Tab|<i5 *^ ' 

\ 3- 'Interpret, a'cl rcle graph v. * \t 

A. iT^t^ir^>ret a J ine grnpfi * 
(f) PredTctlon of Evcntf and Statistics; / 

I • Under stiuid probabi li t IjTS 1 Ike tl>QS^ used li> went her • 
fdVeccistIng or lot tor ios . (the clmr^cc sometfiing will or 
will not Knppcn) 
2. 'Find t\ud u*je averages (mean and median) for a g'roup of 
_^ nuiabers _ _ ^ 



(1) Each public Ichool d 1 s t rVc r sha 1 1 eva 1 ua^e each student * s achieve- 
ment of. riilnrmum standards at least once during the early elementary, ^ 
later ,0 lemcMirary' and ^econdar/ levels, - ' v, , " 

(a) Evaluation of student dchievcment df minimum stond'ardii in \' 
reading, writing and" ma thema t i cs sha H beg I h rfo later than 
the end of the I98O-8I schooJ year, ' \ 
(bV l.VQhialion of student achleyement of minimum star^dnrds \u ' 
' glistening and sp^c^king shall, begirv no; later than the end 
/of the I98I-R2 school y<?ar. ^ • • * 

'school district sha.l 1 determine at which grade or^ grades 
at the early elementary, later elementary and 'secondary, levels students 
shall be eva 1 ir.-j tt^d f or . the. ach i eveiuen t of rfii n imum standards ^ provMed 
tfiat s^coiKKTry leve.:] s Uiden Mi sha 1 I f I rst be *eva Uiated no later than 
the beg i r-tn i nd^:of grade nine, . ^ ^ / ^^ ' 



(3) jO{)ce a public ^c: hoc 1 /di s'fr i c t fias' de terr^l ned . a t/wh 1 ch ' seconds ry 
grade' level to bey i n /t ho>* eva ] ua t i on of s tuden t ach I evemen of minimum 
standards', it sha 1 l^)rov i de for an eva 1 uat i on of student achievement 
of minimuin standards 'at Jeast once^at each succeecjlng grade 1 e^e^l unti l 
th'e student has aci>rev(:d th(e minhmim standards, A secondary ^eyel 



studcrnt \^ho has achictved thV iinnimum standards for a basicYlkill need 
^Ot be ev-aluatcd again in that skill, ^ ' 

{h) At the early and 1 a t er. . e'lVnien tary levels, each public school 
di strict 'sha determine which evaluation i nstruments shall be used 
,to eva>!iato student achievement of mi»n i mum standards 

(5) At the secondary leveT, each public sc^qI district shalt haye the 
option of usin^one or more of the foljowing evaluatlfen i nstru>tients t6 ' " 
evaluate student achievement of mi n i mum standards : 

(a) Evaluation instruments aval table from the Department df Education; 
• (b) Commercially aya 1 1 abl e eva 1 uat Ion instruments approved by the ^ 
DepartgOent of Education; or M ' 

(c) Local.lyi utilized or devel(§f)ed eval uat Ibrtl^^ trumehts^ approved by 
^ the Department of "Education as being ctattjpM^ble'to either (a) 
or (b). . . ^ 
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■(6) In accordance v^th Se'ct 1 on ^4 , 03 of the Chapter 622 Regulations 
.Pertaining to Access \ to Equa I Ed^jcatlonal Opportunity as. adopted by 
the Board of J^B^c^tl^on, a'publlc school district shali not Lise.an 
evfeiuatfpnv Instrument whLch dlscrifpina .the*basjs_ of race» color > 





7. 
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(7) , Af ter nn 
each pub) ic s 



il^ftVu^ t I on |bf 
district 



a student's «cht«ven>ent of ftlnhniim s^tflndards, 
. shall *glve the jftudent ind hfs or her 

parent the oppor^n Uy to reVlew the evaluation Instruments used tnd 
the complete record of »t he student's achievement level. The complete 
record of a student's "achlevi^ment VeveT shal 1 Include, but POt nVcessarily 
be^ 1 Ved . to, thcv <^^or rcfeted /esponscr. of the sttWerYt on "the evolu<itlon 
lnr>tniincn\5 ui^ed, ond shall be m«^lniftino(l ns part of the s tuderu * K' 
teniporc^ry record pur suont to tlie Student ^Necord^f Regulot Ions c»s ndoptojd ' 
by^ tfic Roord of tducatlon. ^' ^ . , ■ 



^0.06j _ FaH^^^ Pvocj^rom Plans , 



(1) The -e^rly elementary and later/elementary program plans shall 
Include, but not nocfe^^s^nr I 1 y be limited to, the fol 1 owl ng componen t s : 
Provision for part I c 1 piVt ion of parents ,Meachers ^ adminis- 
trators, employers, and the go-ncral public in the establ i sh- 
m(:*nl and per ioci i c review of mih imum standards and the overall 
early ijlemer)tary and later elemeatrtry program plans; 
tsrabl i shnu^n^ of mi/i Intum standards for each 'basic skill; 
hes ignai lon of cVppropr I v-» te evahjntJ[on i nsl rumeih<. ; ' 
f^rovi^^ion for appropriat« folloW-up instructional programs 
ancf services to students who have #i(ot achieved minimum 
s tandaj^ds [ ^4 ^ 

Plans for monitoring, evaluating aim mod i f y I nc/, as appropriate, 
the ecu ly elementary and later f K^ment^iry program plans that 
havo^ been cs(lahl i v.hccL Th<^*i)lans shall i nc 1 ude\ such ac t i v I - 
ties as : revievying elementarW progrilms a^ "i curr i cu 1 urn; - •* 

making fiecessary program a'nd/furrlculum changes; conducting 
appropj i cVte'^V^^af f development ef forts , planned In cooperat ion 
v/i t ti olfecMed staff; and i mp 1 omen t i ng .^i /opr late pi ons . for 
monltorincj and eva 1 uat I ng' ttae outcome o; lh?se efforts.. 



(^0 



' appropriate 
I * pr escr i bed by 
d early elementary 
li^sc plans .available 



(2) vhach publ i c.school district shall affirm to t 
Regicrf'ial lukicailqn Cenler, on a form and in o mci>: 
the DcH^artment o[ (iducation^ that it has esi*abl i si 
jnd later elenicnfary program p 1 ans. , and shall make 
to the \ ic * » ■ 

. (a) By August 1, I9BO; each publico, school d * st r i c t ^la 1 1 affiVm 

tIfoV-it ha', es'tabl i sf)i^d' early clementarv and ;later elementary 
program plat^sHn read\j]g, writiiig and >ivi t hema t J cs . 
(b) By August 1, I9BI, each pub 1 i c* school .d i st r 1 ct shall affirm 
^ th^lt i/ fujs estabj i shed^ ear 1 y elementary and 1 ater ^^e 1 emcn tary 

' . program plans InMistenlqcJ and speaking. ^ 

(3) Ec^ch public school district shall '/mjpiement Tis early elementary, 
and later elementary program plans for ^reading, wtv'ting and niathematlcs 
no hiter than October'^ , 1 98O and for lii s ten! n^^ a..d speaki ng no later 
than October -1; J981. - / ♦ * \ • 



\ 
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Secondary kfcvel Program P)<» f) ' ' | n 

»(0 The secondary level pr^ogram plan shall Include, but not necessarily 
btt llmlt^ed to, the following eoftjpr>n«ntS; v , ^ 

- ^ lption|pf|hpvy parents, employers, teachers, admlrr- 

♦ istrator.s, stirc1c|t5 and th(f genfe'ral public part,! cl pated - 

In the esti^bl lshir^«nt of the public school dIsLr'flct's n 
mlnlnuim ntondorcfe ond the overall s'econd:*ry level progr^Vm 
Plf«fi; • 

^ (b) The see6ndary l|yel mlnUum standards establ 1 shed* by llvo • 
t>nblic school d|strlct' and how these secondary Jo minimum 

stAndard^ -Inclirtio- thn-cecondary. level b^^slc sRH Is 9bj-ecrt I ves" 

sot forth in Sole t ion 'jO. OV of thcry« regulations ; 

(c) A listTng of oil evaluation lnsj;ruments designated by the 

publ ic- schooTdj strict. If an eva 1 uat Ion I ns t r umen t. des I gna ted 
. Is not ohe of those made aval 1 able by' the Department of 

education or oh a Department of Tducatlon approved list, the 
•* publ ic school district .shal r submit the fol Iqwl nxj: 
: * 1. a copy of ihe selected eva'luatlon instruments, With 

" . ' ^ ^^^Pljortiricj technical Information; / 
*' ^if'"^ ' ^'nalysls 5,l)owincj the- content catch betwf>en ( 
^^^Mi^^n^lt iimeius and the mlnt-muiii • set forth- 

InrSection k&>^\\ af fhese regulations. . v, / . 

(d) The ^grado. level or levels that the public school district ' 
.has establisfie'dfor^he. Initial , evaluation of set;t>ndai'y level • 

studv^ni achievement of minimum standards; . 

(e) A descripi i4)n of how the pul^l i c school distjrict will provide, 

• and mske generylly available to the p;CiblicL information about 
N I ts secondary level pj-ogram plan, Inciudlc/g such Informatjon 

I as: where in the cur r icu I urti' bij's 1^ sk 1 V 1 s are covered an^- ! . 
. what diagnostic and fol kfi»w-up Instructional services are 
ava i 1 ahl e ; • , • 

(f) . A (lesc-ription of t:he fonow^up 'instruct iona1\pribgrams and 

servjces that the ^publ i c schoo'l d I st r i c t 1 1 'prov 1 dc to 
J. tijd^rnt 5 not. ach i c;y i ng minimum standards ; ' ' 

(g) , 'Assurances that': |i ■ , .' ... 

1. present school? programs and curricula will b- reviewed ^ 
" -for all grades In light of the sctiool district's minimum 
^ " . standards and appropriate modifications will be made ' 
as neceiifxary; ■ ^ 

^ • 1\ curriculunro^id ins.tructlonal -services wl 11 be revij^wed ^ 

/ following ana-f^s 1 s|^nd reporting of ^ttident achievement 

data; . - , • • ^ 

staff .development, efforts wl 1 1 Jje f)lanned In c6nsultation 
witij staff affected and wj 1 1 rfelate *tO . implementation of 
.. y basTc sl<ins improvement program/. '■ , " 

{2) . Each publ ic school dis^ict shal l subml t for "approva 1 to the 
approprjate Rcg ioniil 'Educat i^on ' Cen ter , on a form and . 1 n a mahner 
prescribed by. the Department of Education, It5 se<;ondary level program 
plan-and shall make this plan aval lable to the public. - 

- ^ . .... 




■ (a) Each public school dl strl ct shall submit I ts i^copdary ■■'-'f^i 
level program plan for reading , wri t Ing and^;m?tthemat I cs . .S-'- 

. .. . ^ . . .. . ... .. ^^p I i ^ j. ( hari'-p ' "Zi 

August 1, 1^80/ X—,^ ' ^ / 

' ' ,^ ' (b) tach public school district shall submit Its secondary . ' - 

^ . level jrpgrom pifn for l lstehlng; arid' speaking no^'earlier 

than^'lbruory l , 1981 and no loter ihcin Augiist 1 , I9BI. * 

^iO.OO: Approwil of^ iepondary. l-^^y^l ^^''op/om jMn^ , ' \ ' 

7^: -( v)- Eac K - jVcgion ? (^h~ Coime V 1"o r* a xomm I t f;^ e'de s I rma t Gd " by" t h(?- : ^ - t. 

Council sboll rcvUnv the Oi^condc/ry level pVogrc^ni plcin of yaci) public • 
school district within It^ region. Within sixty (60) ca 1 ^ncfar days 
\ of .receipt af %) public School district's plan, the Reglpna4 Education 

Couru. 1 1 shall recomn>end co t'he Commissioner of Ed/cation approval or * 
' I sapprov:^ of <he sec()hda['yTtvc 1 program pi an . This roconvifendo t i on 
^- -will be based on v/he tlior . or not the plan cohtains the Infoi-mat ion 
- required by Section ^«0.07 (1) and othcrwi se'compl les Avfth the^se ^ 

regulat ions. ^ 

(2) ^Wilhif^ thirty {30) calendar d<-\ys of rece I pt . of the Regional Education " 7] 

Council's recommendation on a public school district's secondary level ^ 
program^ p 1 an , the Comnii ss i oner of Education shall approve or disapprove 
tlie 'secondary level program plan and notify the public school district 
of its action. If a socondacy level prcjgr^ifi pTan Is not approv^fed, ^r. 
• this not i f i c.'it ion shall sta\:e the reasons foV tlie disapproval. •.f: ' 

, ' • . ■ ■ "■ - ' ■ ^ . . ■ ' • V7r . ' .' 

\(3) Each public scliool c' i s t r I c t . sha 1 1 implement the secondary level ' ! 
'^^prograin fSlan for reading, writing sind mathematl/:s approved by the . ^\ 

Cofnmi iont^ir of Educa t i on v/i th t n tli 1 r ty (30) days of notification of 

such ap[>r(\v.:H or by October 1 , 1980, whiclievor occurs *1 aC.er . 



(^) Eocl^ iWiblic school tJlstrjct shall implement the secondary level ^ 
progran) plrV^ for listening i>pea!< I iig'^pprove/d by the Commissioner , , 

of Educot I 01 within thirty (30) day^ jVf hot i f 1 c^t i on of such ^approval , .. 
or l>y Oclol)(Ar T, 1981, whi dfic^'or occurs leJter,^ r ■ 

(5) Upon noty f ixat Ion that a secondary level program plan has been 
disapproved, \» public school district sha 1 1 • have* th I r t y (30) ca 1 endar 
jiays to submir^ an amended secondary level program plan to the appropriate 
Regional Education Center. 'W-ithin thirty (30) calendar days of reteipt > 
of an;amended $ecor)dary level program pl^n, the Regional Educ&tioh . - 
Council or a cotr^mi t tee ^s i gnated by the Council snail review 'the* amend^^ 
secondary level program plan and recommend .to the Comml ss joner^ of Education 
that the amended plan be eT^iher approved* or di sapproved. If .the amerided 
^sccondejry Ifvpl ^program pi an I S' approved , -the public school dis\rict'|- 
shall implement this plan within thirty (30) calendar days of not i f I cat I on . 

(61 Each public school district may change its approved secondary' level 
pimgram pl^ -by subTTTtTtlng an amendment to' Its progrcvn plan to the t 
appropriate Regto/ial Educatljon Center. The Regional Education Counqll 

.... 'V ■ ■: . ■ ■ ; A 



<>j;-«V?o>«P±ttee..^.d^^^^^^^ review the amendinent 

to the prog K»m plan and recommftnd to the Corwulssioner of Education 
^ V that-the amendment be approved or dl ^approved In aeeordahcewi th 
9 the (Provisions of tijis section. No now secondary level program 
plan shc^ll be implemented In pKice of an approved' secondary level 
^ program plan until it has bt-on ap{>rov(!d by the Commissioner of ' . • 

i:ducfllon. ' . ^ "-^^ 

- - ^(I): t<^:ci l-rvn ing ^wi l h„the_.l SB0-_8.i-Schoal _:y.r.ar-,-CN^ch-puh)-i o -selrool — 

(11 strict 11 i.^brW (• an AnnnaJ Report , on o fc)rfii ofid in n mofificr 
Ni^.resTr ibed by t l^e Depor tfocnt of Education, on the i n^) 1 cnientcU i on of 
Jts |)nsic skills Improvemt-nt program. Jho Annual' Report shall include 
/he number ouid percentage of students ^by race, sex, and linguistic 
^ minority who have and have hot acliievcd the minimum standards for < 
. .-each l)asic skill estabi i sIickI by the pub 1 i C; sriiool district for tli\-^ early^ 
elementary, lafer elementary and secondary level s . The Annual Report 
s*iall be submitted to the ap|M'opr4ate Recj i ona b^'^Educat i on- ten ter .by 
Aucjust 31 for tfu- school year, ending tlrt.^. previous Jun^ 30\ 

for thn .]90O ai f^r^iool yl^a r ,^and ecicli yo:ar - thereof ter , each 
P^J^'ic r-cliool district, shalr decide which grade or grc^dcs 
^ witfiin tfie early and i*ater elementary level s shall be used 

to report the number and percen tage of students who liave 
and fvwc not ach i ^^ved- m i n i mum standards, 
(b) f'or the 19^0-81 school year and each year thereafter eacli 

[>ul>]ic school di r>(:r ict sfial 1 decide which grade or grades . . 

A^ithin tl)o secondary level shaHfl be used to report the nimiber 
and perceiUocje oC students wfio have and liave not achieved 
mininuifii standards , prov i ded that, for tlie 1 982 -83 .school year 
^and eacli year thereafter, each public school district shall V 
report tlio numl)er and percentage of students who have com- 
plected o.leventh or twelfth grade and who have arid have not 
' ach i eved ni ! n i nuiin standarcfs. . 

■ V ■ 

(2) tcich pub) I c .scJiooI district shijll release nncJ mol<e general^! y 
ovoiji^flblo to the public th(.i Annual Report required by subsection ' 
(I), and 'ihnll tnke rcaipnnbic <,te[)s to insure tha^ the people -/ 
residing in^ihe public Ccliool district arc* informed of the content 
and avoi i'KTb I l i ty of the Annual R<;;port. - . • ' / 

. - . ■ . ^ -■ ( 

i!Q±i2-i-!'l Jjj^ii:^^^^ Special Ed ucation P r o g r a m s , an d S tudents 

oj_J.[Mri^?.d I_ijJi_Ab^iJj t^ ' 

(1) A public school distr/ct may exempt any student who transfers • 
Into Its school district after having completed the tenth grade in . ' 
another district from tlie annual reporting requ 1 rr ;..ch t s of 'Sect ion ^0. 09 ; ( 

(•2) The evaluation team rospons^lble for developing a student's- 
Individual EducatioriarPlan In accordance with General Laws /Chapter- 71 B , 
t and tKe Chapter 766 Regulations shall detern^ihe wlicther a student In 
^ need of special education shall be evaluated for achievement of the* 
minimum standards pf^ovided for by these regulat io.is i n add i 1 1 on to the 
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■1 1. 



fi 



objectives contained In .the Inaividual rducatlbnol Plan,: and Whether 
the. result of such an evaluation shall bb 'Yne^aded- '\ \\. .the -p.ub 1 1 c 
^hool dtstrlet> an^nual rep<;)rt subml tted pursuant to Section i<0.09J. 
The evaluation tt^am^^ determination shal T be Included In the student 
hull vidua I EducWtional Plan. 



O) F.nch public f^chool district slvill exempt, from all pfo<^if,i.on5 % 
of thc/.e rcA^iliot ions , students who h.ive 1 United tncjlish ab i 1 i ty* ris . ' ' 
^ do:flnr-.d by Gcncrvil Lows, Chapter 71A. Notwi thstanding the previous 
scntetK-e, sUKlcrits who have completed an appro[)r I a t .e^t raos i t i on:i 1 " 
l;i 1 inciunl eclucuion proqrjini i n accordance wi th Gene ral Lflw:^ , Chapter 
1 ■y-I.A-and-thc--P>f-5iu-l-ot ivon s-f or - tt^ig-i rr-Adini lYl s teTfnTrTTo^ IfPTratTsF 
lioiK-.l llillnoual r.ducaiion .-^-loplcd by tho Roord of Educ, t i on V.ho 11 . 

<-onsidero(l as any other ^students for the>ourpose of these recjulatlons 

lLOJJj.„..^±^:i,">i?.L^^^^^ Ituprovement , • 



(1) 



Bo'-.i 
merit 



llio no:ird of education shall establish an Advisory Committee on 
c Skills Iniprovp.mciu to advise on matters related'to the Imple- 
alion.of f fio Board of Education's Policy on R;isJc Skills Improvement 
<:nd these r cq u 1 :) C i (Ml s . » ' ■ 

(<t) Until June 30, 19/9, the Policy Commit lee. on High Sclxnyl 
^ Graduation Reqiij rement s established by t)'ie;,board of Fducation 

^^f' 28, 1977 shall serve as the Advisonr/ Committee, 

(b) -On or before July, \ \ 1979, v. the Board of J^Jucatioh shall 

appoint -no less t han 25 people to serve as vot i nc) members 
of tjvr; AdVi sory. Commit tee. M(>mber V 5'ha 1 1 be appointed for 
two year tcntis^, and niay be r'eqppoi n ted for an acid i t rono 1 . two 
year term. No memt)cr may serve forv^more thru two terms. . 
If an Advisory Committer memb^-' does not tomplete the 
^"^i^Pf^j'^tf-f' term, the Board of E^jcat ion may appoint a member 
to fill the unexpired term and Ah i s member may, upon reappoint' 
nient , serve, two consecutive ful)' terms. Subjsct toappro- 
• . priation, members of the Advisory Committo}e shall be reim- 
bOrsed for expenses necess'ar i 1 y incurred in. tlie performance 
of the i r of f i c i a 1 dut i es . ■ , 

<(?.) flTeqinnincr in l980,-the Advisory Commi ttee *sha 1 1 submit an annual 
report: to, thc^ Petard of Education on or bef.ore September 30 of each year 
to cover tlie preceTiitK] 'ichoo I . year . , 



A0.|5: Waiver 



' ■ * . • • • 

Thf>^ROcird of flduccT^oii nK)y^ \\\)o\^ wri t ten app li cat ion of z\ public school dtstri 
rocommrM)d,-ai,on of t\e cippr\)pr i a t e Regional Edircation Council and Commissioner 



and 

of F-duccj t i Ofi ; qrnnt f) i 
- for good cause . 

^<0J3; Severance Clause 



r of part or all of the requirements of these regulati 



ons 



If any provlslofv contained in tn 
nny pejjson or c i rcunfs tcifH:e is held 
the ren)f)inlng provision? of th< 
»o question to other {)Cf*sons not sil 
shall not be affected thereby 



se.-reguldt ions or the application thereof tcr. 
nvaltd by a court of competent Jur i sdi ct ion , ^ 
jcjulations or the application of the provision 
arly situated or to other circumstances 



> 



1 



tV to Cori«fdi(K ' 
to 



Append ix- J - 



4 



ElinlnatAf S«x «nd Ethnic Blafilh tMCS 



Somr "Dot and Doots" with IU«p«ct t<f Stx-Falmtt« 



A. 



B. 



C. 



No it^o In •nj' test should include sexist language or description. 
Every attempt should be made to avoid 



1. 
2. 



the use of demeaning stereotypes and modifiers ^ 

the use of -male oriented generic .terms .wherever possible 
without making wording complex orxstilted 



a. 



b. 



c. 



avoid generic "he" by use of plurals or change 
1^1 st^ructure • . 



for an anonymous pefs 
sometimes she 



e tines use he. 



3. 



A. 



avoid male oriented terms for occupations and 
materials (e.g., police of ficer ,;.not policeman; 
synthetic, not manmade) ^ ^ 

labelling any attribute, trait , Interest desire or liking 
as masculine or feminine, rather than just human 



describing women or glrls^ by their physical or persohallt;y 
\ qualities^ when men or boysare described by their accomplishments 

In |ach test, every at tempi: should be made 'to include, items that 
1. mention the contributions of women to civilization . 



2. 



3. 



depict woDDftn and girls in laadership, professional and 
managerial roles i^d as active participants, not just as 
receivers or ob9ei;;ver8 

treat 'wooden with respect and their IssifLes and ideas with 
importance 



In each test,, every attempt should be made to achieve balance in the 
way males itnd females, are preHrmfad". 

If one item presents a famale in a stereotypic role, it should 
be balarfced by another presenting her in a more nontradltional 
role or a njale ih a traditionally female role , 

The ways in which males and females are referred to shtfuldNbe 
parallel ^ 



1. 

2. 
3. 



There should be reasonable balance in 'the number of items about 
mAles and Femaie.s . .. ' ■ .■ 
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4. Th«rt 1» balluict in tht wayt in which m«Utiihd f«iinlcr 
«,r« pr«»«nttd with rttptct tiiTbccttpaCion* , •ccomplishmenca, 
rolea, tnd positiv* or n«gactvt trAitr 

5. In « history t list, for t:i:«»pl«, wh^ r«f«rr«nt» will 

n«c««»«ril^ b« pr«dondnant/«oni* it«m» r«f«rriag to womtn 
«nd th«ir eontributions should b« included 

II* Soma Dos snd Donts with Ra»p«ct tJ^thnic Minorities . 

Av^- In writing test vitexfis r tvo^ " " ' - - - 

1. the description of^membera of ethnic minorities in 
tenas of physiqel, personality or intjtrest stereotypes 

2. the use of language which might be considered derogatory 
by minority groiipjr^ 

K 

3. tl\e iis^ of word8^whi<» laight have a different meaning in 
different cultural settings or dialects 

A. the use of subj^ect matter likely to be imfamiliar to 
' minority groups while familiar td the majority ^ 

5. the use bf esoteric vocabulary ' or complex sentence 
structure when that is not what isi being tested 

6. the use of naterial presenting highly controversial or 
prejudiced points of view ^ , * 

^ In each test, every effort should be made to include , _ !f~- 

1. reading material relevant to the interests and concerns 
Of ethnic minorities or stressing the positive values of 
cultural diversity / 

2. reading material presenting positive role models from 
minority groups or which discusses minority contributions 
to science, history, government and thefkrts 

Ijf ; 3. a balanced use of minority and majority related subject 

matter and names of well-known pars oh ail it ies in the context* 
t ' of items testing such things as* grammatical usage 

A. the occasional use ^of names which, suggest membership in* 
* different *thni^c gK)ups for the pcrson/referred to in the 
/context of a problem or question (e.g. , Carlos or Juantta 
* instead of John or Mary in a math problem; Mrs ;Ma r tine lli 

^ or Mr. KrolUcovski as the school principa). instead of 

Miss Spith or Mr. Jones) ' 
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